2024-04-26T11:55:17.391 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T11:55:17.391 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196 --owner scheduled_teuthology@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} --verbose -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/orig.config.yaml 2024-04-26T11:55:17.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:55:17.520 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674196' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuht1w7cqb4eeAMu/L+Cb1nidg3BNtRY8JVnHh95gsdhJurFBpfGEsACSmiDKf4rk+2UXTMJkbqVTaI1/uG5HQ= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKY30irRSJSm116C6XqG/lMuwEV1m7kY5CHXZxQf3Kbms4rKRyVS5M+EoGN4UJTK3HDLcnBhZ/lOJ29fpaFtsDI= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa62qQ2QZ34/56ePRTRcYyUoi1CXk+tAfuCKi1FXlgPvkEyRTj/8t62PSkeIsRunjvPkgbZhFsNZ4IG7r7HVXo= smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH84y4T70o3zzH1UUOYsBYNbO9NLMLdpqr6qLMoQtPMQrOaRkb61w+4LdgKehx3lBe3t8hTDxWHyiN9hgrUUM+U= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T11:55:17.520 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T11:55:17.520 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T11:55:17.521 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T11:55:17.522 INFO:teuthology.task.internal:Checking packages... 2024-04-26T11:55:17.547 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T11:55:17.547 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T11:55:17.547 INFO:teuthology.packaging:ref: None 2024-04-26T11:55:17.547 INFO:teuthology.packaging:tag: None 2024-04-26T11:55:17.547 INFO:teuthology.packaging:branch: reef 2024-04-26T11:55:17.547 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:55:17.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-26T11:55:17.882 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T11:55:17.883 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T11:55:17.889 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T11:55:17.889 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T11:55:17.898 INFO:teuthology.task.internal:Saving configuration 2024-04-26T11:55:17.914 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T11:55:17.921 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T11:55:17.946 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:50:04.339997', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuht1w7cqb4eeAMu/L+Cb1nidg3BNtRY8JVnHh95gsdhJurFBpfGEsACSmiDKf4rk+2UXTMJkbqVTaI1/uG5HQ='} 2024-04-26T11:55:17.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:50:04.342651', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKY30irRSJSm116C6XqG/lMuwEV1m7kY5CHXZxQf3Kbms4rKRyVS5M+EoGN4UJTK3HDLcnBhZ/lOJ29fpaFtsDI='} 2024-04-26T11:55:17.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:50:04.343839', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa62qQ2QZ34/56ePRTRcYyUoi1CXk+tAfuCKi1FXlgPvkEyRTj/8t62PSkeIsRunjvPkgbZhFsNZ4IG7r7HVXo='} 2024-04-26T11:55:18.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:50:04.341446', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH84y4T70o3zzH1UUOYsBYNbO9NLMLdpqr6qLMoQtPMQrOaRkb61w+4LdgKehx3lBe3t8hTDxWHyiN9hgrUUM+U='} 2024-04-26T11:55:18.019 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T11:55:18.026 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T11:55:18.026 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['osd.0'] 2024-04-26T11:55:18.026 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['osd.1'] 2024-04-26T11:55:18.026 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['osd.2'] 2024-04-26T11:55:18.026 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T11:55:18.163 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0056fe40d0>, signals=[15]) 2024-04-26T11:55:18.164 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T11:55:18.170 INFO:teuthology.task.internal:Opening connections... 2024-04-26T11:55:18.170 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-04-26T11:55:18.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:55:18.247 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T11:55:18.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:55:18.316 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-04-26T11:55:18.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:55:18.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-04-26T11:55:18.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:55:18.460 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T11:55:18.469 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-04-26T11:55:18.492 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-04-26T11:55:18.492 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T11:55:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:55:18.554 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:18.554 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T11:55:18.554 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T11:55:18.554 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T11:55:18.554 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T11:55:18.554 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-04-26T11:55:18.579 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-04-26T11:55:18.599 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-04-26T11:55:18.599 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-04-26T11:55:18.661 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T11:55:18.661 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.6" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T11:55:18.662 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T11:55:18.663 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T11:55:18.663 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-04-26T11:55:18.687 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-04-26T11:55:18.708 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-04-26T11:55:18.708 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-04-26T11:55:18.768 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T11:55:18.768 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:18.769 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T11:55:18.770 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T11:55:18.770 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T11:55:18.770 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T11:55:18.770 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-04-26T11:55:18.795 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-26T11:55:18.815 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-26T11:55:18.816 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-26T11:55:18.875 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T11:55:18.875 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T11:55:18.875 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T11:55:18.876 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T11:55:18.877 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T11:55:18.877 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-26T11:55:18.895 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T11:55:18.904 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T11:55:18.915 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T11:55:18.915 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:55:18.918 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:55:18.920 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:55:18.922 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:55:18.942 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T11:55:18.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T11:55:18.953 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:55:18.978 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:55:18.980 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:55:18.984 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:55:19.015 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T11:55:19.122 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T11:55:19.141 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T11:55:19.142 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T11:55:19.142 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:55:19.142 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:55:19.143 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:55:19.143 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:55:19.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:19.163 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-26T11:55:19.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:19.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:19.164 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-04-26T11:55:19.165 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-04-26T11:55:19.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:19.166 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-04-26T11:55:19.222 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.223 INFO:teuthology.task.kernel:Running kernel on smithi071: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-04-26T11:55:19.225 INFO:teuthology.orchestra.run.smithi104.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.225 INFO:teuthology.task.kernel:Running kernel on smithi104: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.225 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-04-26T11:55:19.226 INFO:teuthology.orchestra.run.smithi094.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.226 INFO:teuthology.task.kernel:Running kernel on smithi094: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum install -y kernel 2024-04-26T11:55:19.227 INFO:teuthology.orchestra.run.smithi045.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.227 INFO:teuthology.task.kernel:Running kernel on smithi045: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:19.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2024-04-26T11:55:20.708 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:20.708 INFO:teuthology.orchestra.run.smithi104.stdout:Unable to read consumer identity 2024-04-26T11:55:20.766 INFO:teuthology.orchestra.run.smithi094.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:20.766 INFO:teuthology.orchestra.run.smithi094.stdout:Unable to read consumer identity 2024-04-26T11:55:20.794 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:20.794 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2024-04-26T11:55:20.813 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:20.813 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2024-04-26T11:55:20.946 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:20.946 INFO:teuthology.orchestra.run.smithi104.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:20.946 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:21.035 INFO:teuthology.orchestra.run.smithi094.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:21.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:21.111 INFO:teuthology.orchestra.run.smithi045.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:21.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:21.184 INFO:teuthology.orchestra.run.smithi071.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:21.184 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:22.668 INFO:teuthology.orchestra.run.smithi104.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-04-26T11:55:22.830 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-04-26T11:55:23.002 INFO:teuthology.orchestra.run.smithi094.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-04-26T11:55:23.049 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-04-26T11:55:24.163 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T11:55:24.249 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T11:55:24.482 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2024-04-26T11:55:24.496 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2024-04-26T11:55:27.787 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 514 kB/s | 24 kB 00:00 2024-04-26T11:55:27.905 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 335 kB/s | 24 kB 00:00 2024-04-26T11:55:28.127 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 623 kB/s | 24 kB 00:00 2024-04-26T11:55:28.581 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T11:55:28.581 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T11:55:28.638 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 428 kB/s | 24 kB 00:00 2024-04-26T11:55:28.649 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T11:55:28.649 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T11:55:28.658 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-04-26T11:55:28.659 INFO:teuthology.orchestra.run.smithi094.stdout:Nothing to do. 2024-04-26T11:55:28.660 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-04-26T11:55:28.724 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-04-26T11:55:28.725 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-04-26T11:55:28.726 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-04-26T11:55:28.803 DEBUG:teuthology.orchestra.run.smithi094:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:55:28.855 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T11:55:28.855 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T11:55:28.860 DEBUG:teuthology.orchestra.run.smithi071:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:55:28.939 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-26T11:55:28.940 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-04-26T11:55:28.940 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-26T11:55:29.075 DEBUG:teuthology.orchestra.run.smithi104:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:55:29.136 INFO:teuthology.orchestra.run.smithi094.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:29.136 INFO:teuthology.orchestra.run.smithi094.stdout:Unable to read consumer identity 2024-04-26T11:55:29.196 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:29.196 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2024-04-26T11:55:29.360 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:29.360 INFO:teuthology.orchestra.run.smithi094.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:29.360 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:29.370 INFO:teuthology.orchestra.run.smithi071.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:29.370 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:29.421 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:29.421 INFO:teuthology.orchestra.run.smithi104.stdout:Unable to read consumer identity 2024-04-26T11:55:29.441 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T11:55:29.441 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T11:55:29.520 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-04-26T11:55:29.521 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-04-26T11:55:29.521 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-04-26T11:55:29.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:29.633 INFO:teuthology.orchestra.run.smithi104.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:29.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:29.670 DEBUG:teuthology.orchestra.run.smithi045:> echo no | sudo yum reinstall kernel || true 2024-04-26T11:55:29.675 INFO:teuthology.orchestra.run.smithi094.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:55:27 AM UTC. 2024-04-26T11:55:29.692 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:55:27 AM UTC. 2024-04-26T11:55:29.751 INFO:teuthology.orchestra.run.smithi094.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:29.758 INFO:teuthology.orchestra.run.smithi094.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:29.788 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:29.796 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:29.842 INFO:teuthology.orchestra.run.smithi071.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:29.851 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum reinstall -y kernel || true 2024-04-26T11:55:29.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum reinstall -y kernel || true 2024-04-26T11:55:29.944 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:01 ago on Fri 26 Apr 2024 11:55:28 AM UTC. 2024-04-26T11:55:30.019 INFO:teuthology.orchestra.run.smithi104.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:30.042 INFO:teuthology.orchestra.run.smithi104.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:30.059 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:30.059 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2024-04-26T11:55:30.096 INFO:teuthology.orchestra.run.smithi104.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:30.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum reinstall -y kernel || true 2024-04-26T11:55:30.188 INFO:teuthology.orchestra.run.smithi094.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:30.188 INFO:teuthology.orchestra.run.smithi094.stdout:Unable to read consumer identity 2024-04-26T11:55:30.224 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:30.224 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2024-04-26T11:55:30.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:30.288 INFO:teuthology.orchestra.run.smithi045.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:30.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:30.378 INFO:teuthology.orchestra.run.smithi071.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T11:55:30.479 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:30.480 INFO:teuthology.orchestra.run.smithi104.stdout:Unable to read consumer identity 2024-04-26T11:55:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:30.594 INFO:teuthology.orchestra.run.smithi094.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T11:55:30.630 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:30.630 INFO:teuthology.orchestra.run.smithi104.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:30.630 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T11:55:30.659 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:55:28 AM UTC. 2024-04-26T11:55:30.683 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:55:27 AM UTC. 2024-04-26T11:55:30.746 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:30.747 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:30.765 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:30.780 INFO:teuthology.orchestra.run.smithi071.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:30.818 INFO:teuthology.orchestra.run.smithi045.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:30.826 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:55:30.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum reinstall -y kernel || true 2024-04-26T11:55:30.897 INFO:teuthology.orchestra.run.smithi094.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:55:27 AM UTC. 2024-04-26T11:55:30.943 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:55:28 AM UTC. 2024-04-26T11:55:30.960 INFO:teuthology.orchestra.run.smithi094.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:30.960 INFO:teuthology.orchestra.run.smithi094.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:30.989 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:30.989 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:30.989 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:55:30.989 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T11:55:30.989 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:55:31.009 INFO:teuthology.orchestra.run.smithi104.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:31.009 INFO:teuthology.orchestra.run.smithi104.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:31.010 INFO:teuthology.orchestra.run.smithi094.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:31.025 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-04-26T11:55:31.042 DEBUG:teuthology.parallel:result is None 2024-04-26T11:55:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:31.055 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:55:31.107 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:55:31.259 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-04-26T11:55:31.260 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2024-04-26T11:55:31.260 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:31.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:31.261 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:55:31.261 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T11:55:31.262 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:55:31.281 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:31.282 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:31.282 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:55:31.282 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T11:55:31.283 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:55:31.292 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-04-26T11:55:31.308 DEBUG:teuthology.parallel:result is None 2024-04-26T11:55:31.311 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-04-26T11:55:31.324 DEBUG:teuthology.parallel:result is None 2024-04-26T11:55:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:31.395 INFO:teuthology.orchestra.run.smithi045.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T11:55:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T11:55:31.750 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:55:28 AM UTC. 2024-04-26T11:55:31.825 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T11:55:31.825 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T11:55:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:Error: No packages marked for reinstall. 2024-04-26T11:55:31.927 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:55:32.107 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:32.107 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T11:55:32.107 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T11:55:32.107 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T11:55:32.107 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:55:32.146 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2024-04-26T11:55:32.164 DEBUG:teuthology.parallel:result is None 2024-04-26T11:55:32.164 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T11:55:32.171 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T11:55:32.171 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:55:32.206 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:55:32.209 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:55:32.211 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:55:32.230 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T11:55:32.241 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T11:55:32.257 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T11:55:32.257 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:55:32.266 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:55:32.269 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:55:32.272 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:55:32.312 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T11:55:32.323 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T11:55:32.323 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:55:32.332 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:55:32.336 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:55:32.350 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:55:32.368 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.373 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.379 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.381 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.384 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.385 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.390 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.396 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:55:32.397 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T11:55:32.407 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T11:55:32.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:55:32.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:55:32.429 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:55:32.434 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:55:32.467 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T11:55:32.477 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T11:55:32.477 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:55:32.501 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:55:32.504 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:55:32.506 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:55:32.524 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:32.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:32.665 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:32.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:32.803 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T11:55:32.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:55:32.877 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:32.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:32.985 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:33.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:33.076 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T11:55:33.076 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:55:33.145 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:33.192 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:33.247 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:33.335 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:33.383 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T11:55:33.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:55:33.455 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:33.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:55:33.563 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:33.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:55:33.694 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T11:55:33.694 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:55:33.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-04-26T11:55:33.764 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-04-26T11:55:33.767 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-04-26T11:55:33.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-04-26T11:55:33.816 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:55:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:55:33.821 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:55:33.866 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:55:34.317 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T11:55:34.325 INFO:teuthology.task.internal:Starting timer... 2024-04-26T11:55:34.325 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T11:55:34.337 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T11:55:34.348 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-26T11:55:34.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-04-26T11:55:34.425 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-04-26T11:55:34.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-04-26T11:55:34.489 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-04-26T11:55:34.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-04-26T11:55:34.553 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-04-26T11:55:34.555 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-04-26T11:55:34.612 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-04-26T11:55:34.614 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T11:55:34.614 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-04-26T11:55:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-04-26T11:55:34.635 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-04-26T11:55:34.661 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-04-26T11:55:34.661 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-04-26T11:55:34.682 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-04-26T11:55:34.682 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-04-26T11:55:34.706 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-04-26T11:55:34.707 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi104.front.sepia.ceph.com': 'permissive'} 2024-04-26T11:55:34.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:55:34.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:34.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:55:34.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:34.767 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:55:34.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:34.795 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:55:34.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:55:34.822 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T11:55:34.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:55:34.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:55:34.890 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:55:34.917 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:55:34.945 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T11:55:34.955 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T11:55:34.972 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T11:55:34.974 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi094.front.sepia.ceph.com,smithi104.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:06:19.559 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com')] 2024-04-26T12:06:19.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-04-26T12:06:19.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:06:19.645 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-04-26T12:06:19.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-04-26T12:06:19.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T12:06:19.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:06:19.796 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-26T12:06:19.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T12:06:19.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-26T12:06:19.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:06:19.950 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-04-26T12:06:20.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-04-26T12:06:20.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-26T12:06:20.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:06:20.103 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-26T12:06:20.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-26T12:06:20.179 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:06:20.197 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:06:20.197 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:06:20.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:06:20.200 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:06:20.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:06:20.203 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:06:20.203 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:06:20.205 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:06:20.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:06:20.237 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:06:20.238 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:06:20.239 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:06:20.252 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:06:20.252 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:06:20.255 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:06:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:06:20.267 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:06:20.329 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-04-26T12:06:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-04-26T12:06:20.341 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-04-26T12:06:20.347 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-04-26T12:06:20.347 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-04-26T12:06:20.356 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:06:20.359 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-04-26T12:06:20.362 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-04-26T12:06:20.363 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:06:20.370 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:06:20.371 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-04-26T12:06:20.378 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:06:20.379 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:06:20.385 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:06:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:06:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:06:20.441 INFO:teuthology.orchestra.run.smithi094.stderr:bash: ntpq: command not found 2024-04-26T12:06:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.446 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.447 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.448 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.487 INFO:teuthology.orchestra.run.smithi104.stderr:bash: ntpq: command not found 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.490 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:06:20.491 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:06:20.500 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:06:20.500 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T12:06:20.500 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T12:06:20.500 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:06:20.506 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:06:20.506 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:06:20.507 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:06:20.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:06:20.509 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:06:20.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:06:20.511 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:06:20.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:06:20.512 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:06:20.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:06:20.657 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:06:20.658 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:06:20.665 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:06:20.665 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:06:20.743 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:06:20.743 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:06:20.755 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:06:20.755 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:06:20.770 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:06:20.770 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:06:20.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:06:20.815 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:06:20.815 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:06:20.836 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:06:20.836 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:06:20.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:06:20.859 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:06:20.859 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:06:20.860 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:06:20.866 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:06:20.866 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:06:20.889 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:06:20.889 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:06:20.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:06:20.924 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:06:20.925 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:06:20.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:06:20.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:06:20.957 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:06:20.957 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:06:20.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:06:20.979 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:06:21.011 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-04-26T12:06:21.012 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-04-26T12:06:21.014 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:06:21.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:06:21.036 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:06:21.081 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-04-26T12:06:21.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-04-26T12:06:21.102 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-04-26T12:06:21.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-04-26T12:06:21.107 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:06:21.176 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-04-26T12:06:21.177 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-04-26T12:06:21.448 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:21.458 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:21.482 INFO:teuthology.orchestra.run.smithi094.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:21.559 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:22.744 INFO:teuthology.orchestra.run.smithi094.stdout:63 files removed 2024-04-26T12:06:22.800 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:06:22.814 INFO:teuthology.orchestra.run.smithi045.stdout:63 files removed 2024-04-26T12:06:22.821 INFO:teuthology.orchestra.run.smithi071.stdout:63 files removed 2024-04-26T12:06:22.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:06:22.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:06:22.990 INFO:teuthology.orchestra.run.smithi104.stdout:63 files removed 2024-04-26T12:06:23.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:06:23.140 INFO:teuthology.orchestra.run.smithi094.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:23.217 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:23.253 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:23.382 INFO:teuthology.orchestra.run.smithi104.stdout:Updating Subscription Management repositories. 2024-04-26T12:06:25.011 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 219 kB/s | 80 kB 00:00 2024-04-26T12:06:25.137 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 207 kB/s | 80 kB 00:00 2024-04-26T12:06:25.276 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 184 kB/s | 80 kB 00:00 2024-04-26T12:06:25.326 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 298 kB/s | 80 kB 00:00 2024-04-26T12:06:25.397 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-26T12:06:25.576 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-04-26T12:06:25.644 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 40 kB/s | 11 kB 00:00 2024-04-26T12:06:25.738 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2024-04-26T12:06:25.835 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-04-26T12:06:25.860 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2024-04-26T12:06:25.905 INFO:teuthology.orchestra.run.smithi094.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T12:06:25.944 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 5.4 kB/s | 1.5 kB 00:00 2024-04-26T12:06:26.011 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-26T12:06:26.086 INFO:teuthology.orchestra.run.smithi104.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2024-04-26T12:06:26.157 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-04-26T12:06:26.316 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-26T12:06:27.239 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T12:06:27.266 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-26T12:06:27.767 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2024-04-26T12:06:27.829 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2024-04-26T12:06:30.845 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 437 kB/s | 24 kB 00:00 2024-04-26T12:06:31.358 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 397 kB/s | 24 kB 00:00 2024-04-26T12:06:31.370 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 413 kB/s | 24 kB 00:00 2024-04-26T12:06:31.382 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 390 kB/s | 24 kB 00:00 2024-04-26T12:06:31.563 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-04-26T12:06:31.993 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 16 MB/s | 8.8 MB 00:00 2024-04-26T12:06:32.664 INFO:teuthology.orchestra.run.smithi104.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 55 MB/s | 67 MB 00:01 2024-04-26T12:06:32.892 INFO:teuthology.orchestra.run.smithi094.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 60 MB 00:01 2024-04-26T12:06:34.406 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 67 MB 00:01 2024-04-26T12:06:35.161 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 67 MB 00:01 2024-04-26T12:06:42.863 INFO:teuthology.orchestra.run.smithi104.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-04-26T12:06:43.610 INFO:teuthology.orchestra.run.smithi094.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-04-26T12:06:45.348 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 60 MB 00:01 2024-04-26T12:06:45.797 INFO:teuthology.orchestra.run.smithi104.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 50 MB/s | 60 MB 00:01 2024-04-26T12:06:46.828 INFO:teuthology.orchestra.run.smithi094.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 42 MB/s | 67 MB 00:01 2024-04-26T12:06:47.645 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 60 MB 00:01 2024-04-26T12:07:01.118 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:01.119 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:01.348 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-04-26T12:07:01.361 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================================================================== 2024-04-26T12:07:01.361 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================================================================== 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:07:01.362 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:07:01.363 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:07:01.364 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:07:01.365 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:07:01.366 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:07:01.367 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:07:01.368 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:01.369 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:07:01.370 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:07:01.371 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-04-26T12:07:01.372 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================================================================== 2024-04-26T12:07:01.373 INFO:teuthology.orchestra.run.smithi071.stdout:Install 122 Packages 2024-04-26T12:07:01.373 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 14 Packages 2024-04-26T12:07:01.373 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:07:01.373 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 206 M 2024-04-26T12:07:01.373 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-04-26T12:07:01.518 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:01.519 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:01.679 INFO:teuthology.orchestra.run.smithi071.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2024-04-26T12:07:01.742 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-26T12:07:01.755 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================================================================== 2024-04-26T12:07:01.755 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-26T12:07:01.755 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================================================================== 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:07:01.756 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:07:01.757 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:07:01.758 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:07:01.759 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:07:01.760 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:07:01.761 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:07:01.762 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:07:01.763 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:07:01.764 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:07:01.765 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:07:01.765 INFO:teuthology.orchestra.run.smithi104.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:07:01.765 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:07:01.765 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:07:01.765 INFO:teuthology.orchestra.run.smithi104.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:07:01.765 INFO:teuthology.orchestra.run.smithi104.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================================================================== 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout:Install 122 Packages 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 14 Packages 2024-04-26T12:07:01.766 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:07:01.767 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 206 M 2024-04-26T12:07:01.767 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-26T12:07:01.771 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:01.772 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:02.006 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-04-26T12:07:02.019 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================================================================== 2024-04-26T12:07:02.019 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-04-26T12:07:02.020 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================================================================== 2024-04-26T12:07:02.020 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-04-26T12:07:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:07:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:07:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:07:02.020 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:07:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:07:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:07:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:07:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:07:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:07:02.021 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:07:02.022 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:07:02.022 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:07:02.022 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:07:02.022 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:07:02.022 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:07:02.023 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:07:02.023 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:07:02.023 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:07:02.023 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:07:02.023 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:07:02.023 INFO:teuthology.orchestra.run.smithi094.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:07:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:07:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:07:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:07:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:07:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:07:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:07:02.025 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:07:02.025 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:07:02.025 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:07:02.025 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:07:02.025 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-04-26T12:07:02.025 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:07:02.026 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:07:02.026 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:07:02.026 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:07:02.026 INFO:teuthology.orchestra.run.smithi094.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:07:02.026 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:07:02.026 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:07:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:07:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:07:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:07:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:07:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:07:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:07:02.028 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:07:02.028 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-04-26T12:07:02.028 INFO:teuthology.orchestra.run.smithi094.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:07:02.028 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:07:02.028 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:07:02.028 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:07:02.029 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:07:02.029 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:07:02.029 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:07:02.029 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:07:02.029 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:07:02.029 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:07:02.030 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:07:02.030 INFO:teuthology.orchestra.run.smithi094.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:07:02.030 INFO:teuthology.orchestra.run.smithi094.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:07:02.030 INFO:teuthology.orchestra.run.smithi094.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:07:02.030 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:07:02.031 INFO:teuthology.orchestra.run.smithi094.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:07:02.031 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:07:02.031 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:07:02.031 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:07:02.031 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:07:02.031 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:07:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:07:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:07:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:07:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:07:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:07:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:07:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:07:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:07:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:07:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:07:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:07:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:07:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:07:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:07:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:07:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:07:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:07:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:07:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:07:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:07:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:07:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:07:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:07:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:07:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:07:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:07:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:07:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:07:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:07:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:07:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:07:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:07:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:07:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:07:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:07:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:07:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:07:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:07:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:07:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:07:02.039 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:07:02.039 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:07:02.039 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:07:02.039 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:07:02.040 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:07:02.040 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:07:02.040 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:07:02.040 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:07:02.040 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:07:02.040 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:07:02.041 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:07:02.041 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:02.041 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:07:02.041 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:07:02.041 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:07:02.041 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:07:02.042 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:07:02.042 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:07:02.042 INFO:teuthology.orchestra.run.smithi094.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:07:02.042 INFO:teuthology.orchestra.run.smithi094.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:07:02.042 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:07:02.042 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:07:02.043 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:07:02.043 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:07:02.043 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:07:02.043 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:07:02.043 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:07:02.043 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:07:02.044 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:07:02.044 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:07:02.044 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-04-26T12:07:02.044 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================================================================== 2024-04-26T12:07:02.044 INFO:teuthology.orchestra.run.smithi094.stdout:Install 122 Packages 2024-04-26T12:07:02.044 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 14 Packages 2024-04-26T12:07:02.045 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:07:02.046 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 206 M 2024-04-26T12:07:02.046 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-04-26T12:07:02.104 INFO:teuthology.orchestra.run.smithi104.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 54 kB/s | 6.4 kB 00:00 2024-04-26T12:07:02.180 INFO:teuthology.orchestra.run.smithi071.stdout:(2/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 7.4 MB/s | 5.5 MB 00:00 2024-04-26T12:07:02.242 INFO:teuthology.orchestra.run.smithi071.stdout:(3/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.5 MB/s | 859 kB 00:00 2024-04-26T12:07:02.255 INFO:teuthology.orchestra.run.smithi071.stdout:(4/136): ceph-immutable-object-cache-18.2.2-125 2.2 MB/s | 165 kB 00:00 2024-04-26T12:07:02.330 INFO:teuthology.orchestra.run.smithi104.stdout:(2/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 3.7 MB/s | 859 kB 00:00 2024-04-26T12:07:02.338 INFO:teuthology.orchestra.run.smithi094.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2024-04-26T12:07:02.438 INFO:teuthology.orchestra.run.smithi104.stdout:(3/136): ceph-immutable-object-cache-18.2.2-125 1.5 MB/s | 165 kB 00:00 2024-04-26T12:07:02.599 INFO:teuthology.orchestra.run.smithi071.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 4.5 MB/s | 1.6 MB 00:00 2024-04-26T12:07:02.947 INFO:teuthology.orchestra.run.smithi071.stdout:(6/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 3.2 MB/s | 2.3 MB 00:00 2024-04-26T12:07:03.080 INFO:teuthology.orchestra.run.smithi104.stdout:(4/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 3.5 MB/s | 2.3 MB 00:00 2024-04-26T12:07:03.566 INFO:teuthology.orchestra.run.smithi104.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 3.2 MB/s | 1.6 MB 00:00 2024-04-26T12:07:03.664 INFO:teuthology.orchestra.run.smithi071.stdout:(7/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 4.5 MB/s | 4.8 MB 00:01 2024-04-26T12:07:03.756 INFO:teuthology.orchestra.run.smithi104.stdout:(6/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 3.1 MB/s | 5.5 MB 00:01 2024-04-26T12:07:04.496 INFO:teuthology.orchestra.run.smithi094.stdout:(2/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 398 kB/s | 859 kB 00:02 2024-04-26T12:07:04.889 INFO:teuthology.orchestra.run.smithi104.stdout:(7/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 3.6 MB/s | 4.8 MB 00:01 2024-04-26T12:07:05.030 INFO:teuthology.orchestra.run.smithi094.stdout:(3/136): ceph-immutable-object-cache-18.2.2-125 310 kB/s | 165 kB 00:00 2024-04-26T12:07:05.313 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:05.314 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:07:05.568 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-04-26T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================================================================== 2024-04-26T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-04-26T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================================================================== 2024-04-26T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-04-26T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:07:05.584 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:07:05.587 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:07:05.588 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:07:05.589 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:07:05.590 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:07:05.591 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:07:05.592 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================================================================== 2024-04-26T12:07:05.593 INFO:teuthology.orchestra.run.smithi045.stdout:Install 122 Packages 2024-04-26T12:07:05.594 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 14 Packages 2024-04-26T12:07:05.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:07:05.594 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 206 M 2024-04-26T12:07:05.594 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-04-26T12:07:06.080 INFO:teuthology.orchestra.run.smithi094.stdout:(4/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 1.4 MB/s | 5.5 MB 00:03 2024-04-26T12:07:06.106 INFO:teuthology.orchestra.run.smithi071.stdout:(8/136): ceph-common-18.2.2-1256.gdc093b5e.el8. 4.6 MB/s | 22 MB 00:04 2024-04-26T12:07:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2024-04-26T12:07:06.256 INFO:teuthology.orchestra.run.smithi071.stdout:(9/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el8 5.1 MB/s | 13 MB 00:02 2024-04-26T12:07:06.281 INFO:teuthology.orchestra.run.smithi071.stdout:(10/136): ceph-selinux-18.2.2-1256.gdc093b5e.el 139 kB/s | 24 kB 00:00 2024-04-26T12:07:06.390 INFO:teuthology.orchestra.run.smithi071.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 285 kB/s | 31 kB 00:00 2024-04-26T12:07:06.414 INFO:teuthology.orchestra.run.smithi104.stdout:(8/136): ceph-common-18.2.2-1256.gdc093b5e.el8. 4.9 MB/s | 22 MB 00:04 2024-04-26T12:07:06.514 INFO:teuthology.orchestra.run.smithi104.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 244 kB/s | 24 kB 00:00 2024-04-26T12:07:06.686 INFO:teuthology.orchestra.run.smithi045.stdout:(2/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.5 MB/s | 859 kB 00:00 2024-04-26T12:07:06.698 INFO:teuthology.orchestra.run.smithi071.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.5 MB/s | 781 kB 00:00 2024-04-26T12:07:06.770 INFO:teuthology.orchestra.run.smithi045.stdout:(3/136): ceph-immutable-object-cache-18.2.2-125 1.9 MB/s | 165 kB 00:00 2024-04-26T12:07:06.799 INFO:teuthology.orchestra.run.smithi071.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.4 MB/s | 142 kB 00:00 2024-04-26T12:07:06.915 INFO:teuthology.orchestra.run.smithi071.stdout:(14/136): librados-devel-18.2.2-1256.gdc093b5e. 1.2 MB/s | 139 kB 00:00 2024-04-26T12:07:07.124 INFO:teuthology.orchestra.run.smithi071.stdout:(15/136): libradosstriper1-18.2.2-1256.gdc093b5 2.2 MB/s | 474 kB 00:00 2024-04-26T12:07:07.205 INFO:teuthology.orchestra.run.smithi094.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 1.4 MB/s | 1.6 MB 00:01 2024-04-26T12:07:07.770 INFO:teuthology.orchestra.run.smithi045.stdout:(4/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 2.3 MB/s | 2.3 MB 00:00 2024-04-26T12:07:08.256 INFO:teuthology.orchestra.run.smithi104.stdout:(10/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el 3.9 MB/s | 13 MB 00:03 2024-04-26T12:07:08.356 INFO:teuthology.orchestra.run.smithi104.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 310 kB/s | 31 kB 00:00 2024-04-26T12:07:08.370 INFO:teuthology.orchestra.run.smithi045.stdout:(5/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 2.1 MB/s | 5.5 MB 00:02 2024-04-26T12:07:08.404 INFO:teuthology.orchestra.run.smithi045.stdout:(6/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 2.5 MB/s | 1.6 MB 00:00 2024-04-26T12:07:08.432 INFO:teuthology.orchestra.run.smithi071.stdout:(16/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 3.4 MB/s | 18 MB 00:05 2024-04-26T12:07:08.516 INFO:teuthology.orchestra.run.smithi071.stdout:(17/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 4.7 MB/s | 6.6 MB 00:01 2024-04-26T12:07:08.541 INFO:teuthology.orchestra.run.smithi071.stdout:(18/136): python3-ceph-argparse-18.2.2-1256.gdc 412 kB/s | 45 kB 00:00 2024-04-26T12:07:08.570 INFO:teuthology.orchestra.run.smithi104.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 3.6 MB/s | 781 kB 00:00 2024-04-26T12:07:08.600 INFO:teuthology.orchestra.run.smithi071.stdout:(19/136): python3-ceph-common-18.2.2-1256.gdc09 1.5 MB/s | 129 kB 00:00 2024-04-26T12:07:08.648 INFO:teuthology.orchestra.run.smithi104.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.8 MB/s | 142 kB 00:00 2024-04-26T12:07:08.692 INFO:teuthology.orchestra.run.smithi071.stdout:(20/136): python3-cephfs-18.2.2-1256.gdc093b5e. 1.3 MB/s | 197 kB 00:00 2024-04-26T12:07:08.717 INFO:teuthology.orchestra.run.smithi071.stdout:(21/136): python3-rados-18.2.2-1256.gdc093b5e.e 3.1 MB/s | 371 kB 00:00 2024-04-26T12:07:08.732 INFO:teuthology.orchestra.run.smithi104.stdout:(14/136): librados-devel-18.2.2-1256.gdc093b5e. 1.6 MB/s | 139 kB 00:00 2024-04-26T12:07:08.809 INFO:teuthology.orchestra.run.smithi071.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.1 MB/s | 107 kB 00:00 2024-04-26T12:07:08.851 INFO:teuthology.orchestra.run.smithi071.stdout:(23/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 2.2 MB/s | 364 kB 00:00 2024-04-26T12:07:08.893 INFO:teuthology.orchestra.run.smithi071.stdout:(24/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.1 MB/s | 95 kB 00:00 2024-04-26T12:07:08.932 INFO:teuthology.orchestra.run.smithi104.stdout:(15/136): libradosstriper1-18.2.2-1256.gdc093b5 2.3 MB/s | 474 kB 00:00 2024-04-26T12:07:08.985 INFO:teuthology.orchestra.run.smithi071.stdout:(25/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.9 MB/s | 181 kB 00:00 2024-04-26T12:07:09.022 INFO:teuthology.orchestra.run.smithi094.stdout:(6/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 583 kB/s | 2.3 MB 00:03 2024-04-26T12:07:09.068 INFO:teuthology.orchestra.run.smithi071.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1256.g 292 kB/s | 24 kB 00:00 2024-04-26T12:07:09.186 INFO:teuthology.orchestra.run.smithi071.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.2 MB/s | 138 kB 00:00 2024-04-26T12:07:10.019 INFO:teuthology.orchestra.run.smithi071.stdout:(28/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 4.2 MB/s | 3.5 MB 00:00 2024-04-26T12:07:10.179 INFO:teuthology.orchestra.run.smithi045.stdout:(7/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 2.7 MB/s | 4.8 MB 00:01 2024-04-26T12:07:10.219 INFO:teuthology.orchestra.run.smithi071.stdout:(29/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 2.5 MB/s | 3.5 MB 00:01 2024-04-26T12:07:10.249 INFO:teuthology.orchestra.run.smithi104.stdout:(16/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 2.8 MB/s | 18 MB 00:06 2024-04-26T12:07:10.374 INFO:teuthology.orchestra.run.smithi104.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 358 kB/s | 45 kB 00:00 2024-04-26T12:07:10.402 INFO:teuthology.orchestra.run.smithi071.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 1.3 MB/s | 246 kB 00:00 2024-04-26T12:07:10.483 INFO:teuthology.orchestra.run.smithi104.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 1.2 MB/s | 129 kB 00:00 2024-04-26T12:07:10.511 INFO:teuthology.orchestra.run.smithi071.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 454 kB/s | 49 kB 00:00 2024-04-26T12:07:10.620 INFO:teuthology.orchestra.run.smithi071.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 140 kB/s | 15 kB 00:00 2024-04-26T12:07:10.655 INFO:teuthology.orchestra.run.smithi094.stdout:(7/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 1.4 MB/s | 4.8 MB 00:03 2024-04-26T12:07:10.666 INFO:teuthology.orchestra.run.smithi104.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 1.0 MB/s | 197 kB 00:00 2024-04-26T12:07:10.804 INFO:teuthology.orchestra.run.smithi071.stdout:(33/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 1.4 MB/s | 263 kB 00:00 2024-04-26T12:07:10.866 INFO:teuthology.orchestra.run.smithi104.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 1.8 MB/s | 371 kB 00:00 2024-04-26T12:07:10.921 INFO:teuthology.orchestra.run.smithi071.stdout:(34/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.4 MB/s | 173 kB 00:00 2024-04-26T12:07:11.117 INFO:teuthology.orchestra.run.smithi104.stdout:(21/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 3.0 MB/s | 6.6 MB 00:02 2024-04-26T12:07:11.142 INFO:teuthology.orchestra.run.smithi104.stdout:(22/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 364 kB 00:00 2024-04-26T12:07:11.145 INFO:teuthology.orchestra.run.smithi071.stdout:(35/136): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2024-04-26T12:07:11.200 INFO:teuthology.orchestra.run.smithi104.stdout:(23/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 107 kB 00:00 2024-04-26T12:07:11.204 INFO:teuthology.orchestra.run.smithi071.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-04-26T12:07:11.255 INFO:teuthology.orchestra.run.smithi071.stdout:(37/136): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-04-26T12:07:11.259 INFO:teuthology.orchestra.run.smithi104.stdout:(24/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 809 kB/s | 95 kB 00:00 2024-04-26T12:07:11.363 INFO:teuthology.orchestra.run.smithi071.stdout:(38/136): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2024-04-26T12:07:11.367 INFO:teuthology.orchestra.run.smithi104.stdout:(25/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.6 MB/s | 181 kB 00:00 2024-04-26T12:07:11.414 INFO:teuthology.orchestra.run.smithi071.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2024-04-26T12:07:11.480 INFO:teuthology.orchestra.run.smithi071.stdout:(40/136): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2024-04-26T12:07:11.484 INFO:teuthology.orchestra.run.smithi104.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1256.g 208 kB/s | 24 kB 00:00 2024-04-26T12:07:11.564 INFO:teuthology.orchestra.run.smithi071.stdout:(41/136): ceph-mgr-diskprediction-local-18.2.2- 4.8 MB/s | 7.4 MB 00:01 2024-04-26T12:07:11.584 INFO:teuthology.orchestra.run.smithi104.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.4 MB/s | 138 kB 00:00 2024-04-26T12:07:11.589 INFO:teuthology.orchestra.run.smithi071.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2024-04-26T12:07:11.648 INFO:teuthology.orchestra.run.smithi071.stdout:(43/136): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2024-04-26T12:07:11.682 INFO:teuthology.orchestra.run.smithi071.stdout:(44/136): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2024-04-26T12:07:11.715 INFO:teuthology.orchestra.run.smithi071.stdout:(45/136): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2024-04-26T12:07:11.765 INFO:teuthology.orchestra.run.smithi071.stdout:(46/136): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-04-26T12:07:11.828 INFO:teuthology.orchestra.run.smithi071.stdout:(47/136): python3-google-auth-1.1.1-10.el8.noar 558 kB/s | 81 kB 00:00 2024-04-26T12:07:11.858 INFO:teuthology.orchestra.run.smithi071.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-04-26T12:07:11.916 INFO:teuthology.orchestra.run.smithi071.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 837 kB/s | 49 kB 00:00 2024-04-26T12:07:11.966 INFO:teuthology.orchestra.run.smithi071.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2024-04-26T12:07:12.025 INFO:teuthology.orchestra.run.smithi071.stdout:(51/136): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2024-04-26T12:07:12.059 INFO:teuthology.orchestra.run.smithi071.stdout:(52/136): python3-kubernetes-11.0.0-6.el8.noarc 5.1 MB/s | 1.2 MB 00:00 2024-04-26T12:07:12.092 INFO:teuthology.orchestra.run.smithi071.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2024-04-26T12:07:12.110 INFO:teuthology.orchestra.run.smithi071.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2024-04-26T12:07:12.143 INFO:teuthology.orchestra.run.smithi071.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2024-04-26T12:07:12.209 INFO:teuthology.orchestra.run.smithi071.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.0 MB/s | 196 kB 00:00 2024-04-26T12:07:12.235 INFO:teuthology.orchestra.run.smithi071.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 697 kB/s | 64 kB 00:00 2024-04-26T12:07:12.277 INFO:teuthology.orchestra.run.smithi071.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 262 kB/s | 19 kB 00:00 2024-04-26T12:07:12.285 INFO:teuthology.orchestra.run.smithi104.stdout:(28/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 3.2 MB/s | 3.5 MB 00:01 2024-04-26T12:07:12.296 INFO:teuthology.orchestra.run.smithi071.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2024-04-26T12:07:12.342 INFO:teuthology.orchestra.run.smithi071.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2024-04-26T12:07:12.345 INFO:teuthology.orchestra.run.smithi071.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2024-04-26T12:07:12.395 INFO:teuthology.orchestra.run.smithi071.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2024-04-26T12:07:12.421 INFO:teuthology.orchestra.run.smithi071.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2024-04-26T12:07:12.462 INFO:teuthology.orchestra.run.smithi071.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 918 kB/s | 61 kB 00:00 2024-04-26T12:07:12.488 INFO:teuthology.orchestra.run.smithi071.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2024-04-26T12:07:12.513 INFO:teuthology.orchestra.run.smithi071.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 456 kB/s | 23 kB 00:00 2024-04-26T12:07:12.530 INFO:teuthology.orchestra.run.smithi071.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-04-26T12:07:12.630 INFO:teuthology.orchestra.run.smithi071.stdout:(68/136): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2024-04-26T12:07:12.889 INFO:teuthology.orchestra.run.smithi071.stdout:(69/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 69 kB/s | 18 kB 00:00 2024-04-26T12:07:12.914 INFO:teuthology.orchestra.run.smithi071.stdout:(70/136): python3-packaging-16.8-9.el8.noarch.r 126 kB/s | 48 kB 00:00 2024-04-26T12:07:13.060 INFO:teuthology.orchestra.run.smithi104.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 2.4 MB/s | 3.5 MB 00:01 2024-04-26T12:07:13.148 INFO:teuthology.orchestra.run.smithi071.stdout:(71/136): python3-oauthlib-2.1.0-1.el8.noarch.r 664 kB/s | 155 kB 00:00 2024-04-26T12:07:13.173 INFO:teuthology.orchestra.run.smithi071.stdout:(72/136): python3-jwt-1.6.1-2.el8.noarch.rpm 150 kB/s | 43 kB 00:00 2024-04-26T12:07:13.227 INFO:teuthology.orchestra.run.smithi104.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 1.4 MB/s | 246 kB 00:00 2024-04-26T12:07:13.310 INFO:teuthology.orchestra.run.smithi104.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 591 kB/s | 49 kB 00:00 2024-04-26T12:07:13.379 INFO:teuthology.orchestra.run.smithi045.stdout:(8/136): ceph-common-18.2.2-1256.gdc093b5e.el8. 2.8 MB/s | 22 MB 00:07 2024-04-26T12:07:13.386 INFO:teuthology.orchestra.run.smithi104.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 203 kB/s | 15 kB 00:00 2024-04-26T12:07:13.448 INFO:teuthology.orchestra.run.smithi071.stdout:(73/136): python3-requests-oauthlib-1.0.0-1.el8 155 kB/s | 43 kB 00:00 2024-04-26T12:07:13.471 INFO:teuthology.orchestra.run.smithi045.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 266 kB/s | 24 kB 00:00 2024-04-26T12:07:13.473 INFO:teuthology.orchestra.run.smithi071.stdout:(74/136): python3-pycparser-2.14-14.el8.noarch. 335 kB/s | 109 kB 00:00 2024-04-26T12:07:13.553 INFO:teuthology.orchestra.run.smithi104.stdout:(33/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 1.5 MB/s | 263 kB 00:00 2024-04-26T12:07:13.653 INFO:teuthology.orchestra.run.smithi104.stdout:(34/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.7 MB/s | 173 kB 00:00 2024-04-26T12:07:13.755 INFO:teuthology.orchestra.run.smithi045.stdout:(10/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 3.4 MB/s | 18 MB 00:05 2024-04-26T12:07:13.782 INFO:teuthology.orchestra.run.smithi071.stdout:(75/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 142 kB/s | 44 kB 00:00 2024-04-26T12:07:13.807 INFO:teuthology.orchestra.run.smithi071.stdout:(76/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 52 kB/s | 19 kB 00:00 2024-04-26T12:07:13.879 INFO:teuthology.orchestra.run.smithi045.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 249 kB/s | 31 kB 00:00 2024-04-26T12:07:14.112 INFO:teuthology.orchestra.run.smithi071.stdout:(77/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 752 kB/s | 229 kB 00:00 2024-04-26T12:07:14.147 INFO:teuthology.orchestra.run.smithi045.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.9 MB/s | 781 kB 00:00 2024-04-26T12:07:14.149 INFO:teuthology.orchestra.run.smithi071.stdout:(78/136): pcre2-devel-10.32-2.el8.x86_64.rpm 1.6 MB/s | 605 kB 00:00 2024-04-26T12:07:14.178 INFO:teuthology.orchestra.run.smithi104.stdout:(35/136): ceph-mgr-diskprediction-local-18.2.2- 3.9 MB/s | 7.4 MB 00:01 2024-04-26T12:07:14.239 INFO:teuthology.orchestra.run.smithi045.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.5 MB/s | 142 kB 00:00 2024-04-26T12:07:14.328 INFO:teuthology.orchestra.run.smithi104.stdout:(36/136): gperftools-libs-2.7-9.el8.x86_64.rpm 454 kB/s | 306 kB 00:00 2024-04-26T12:07:14.391 INFO:teuthology.orchestra.run.smithi071.stdout:(79/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 790 kB/s | 220 kB 00:00 2024-04-26T12:07:14.414 INFO:teuthology.orchestra.run.smithi045.stdout:(14/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el 3.1 MB/s | 13 MB 00:04 2024-04-26T12:07:14.445 INFO:teuthology.orchestra.run.smithi104.stdout:(37/136): libunwind-1.3.1-3.el8.x86_64.rpm 644 kB/s | 75 kB 00:00 2024-04-26T12:07:14.456 INFO:teuthology.orchestra.run.smithi045.stdout:(15/136): librados-devel-18.2.2-1256.gdc093b5e. 641 kB/s | 139 kB 00:00 2024-04-26T12:07:14.458 INFO:teuthology.orchestra.run.smithi071.stdout:(80/136): libselinux-devel-2.9-5.el8.x86_64.rpm 648 kB/s | 200 kB 00:00 2024-04-26T12:07:14.584 INFO:teuthology.orchestra.run.smithi071.stdout:(81/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 251 kB/s | 48 kB 00:00 2024-04-26T12:07:14.589 INFO:teuthology.orchestra.run.smithi045.stdout:(16/136): libradosstriper1-18.2.2-1256.gdc093b5 2.6 MB/s | 474 kB 00:00 2024-04-26T12:07:14.609 INFO:teuthology.orchestra.run.smithi071.stdout:(82/136): libsepol-devel-2.9-3.el8.x86_64.rpm 579 kB/s | 87 kB 00:00 2024-04-26T12:07:14.621 INFO:teuthology.orchestra.run.smithi104.stdout:(38/136): liboath-2.6.2-3.el8.x86_64.rpm 133 kB/s | 59 kB 00:00 2024-04-26T12:07:14.654 INFO:teuthology.orchestra.run.smithi104.stdout:(39/136): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2024-04-26T12:07:14.673 INFO:teuthology.orchestra.run.smithi045.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 535 kB/s | 45 kB 00:00 2024-04-26T12:07:14.740 INFO:teuthology.orchestra.run.smithi045.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 1.9 MB/s | 129 kB 00:00 2024-04-26T12:07:14.754 INFO:teuthology.orchestra.run.smithi104.stdout:(40/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 327 kB/s | 44 kB 00:00 2024-04-26T12:07:14.768 INFO:teuthology.orchestra.run.smithi071.stdout:(83/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 314 kB/s | 58 kB 00:00 2024-04-26T12:07:14.781 INFO:teuthology.orchestra.run.smithi104.stdout:(41/136): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2024-04-26T12:07:14.810 INFO:teuthology.orchestra.run.smithi071.stdout:(84/136): libcom_err-devel-1.45.6-4.el8.x86_64. 192 kB/s | 39 kB 00:00 2024-04-26T12:07:14.824 INFO:teuthology.orchestra.run.smithi045.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 2.3 MB/s | 197 kB 00:00 2024-04-26T12:07:14.910 INFO:teuthology.orchestra.run.smithi104.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 213 kB/s | 33 kB 00:00 2024-04-26T12:07:14.939 INFO:teuthology.orchestra.run.smithi104.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 103 kB/s | 16 kB 00:00 2024-04-26T12:07:14.957 INFO:teuthology.orchestra.run.smithi045.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 2.7 MB/s | 371 kB 00:00 2024-04-26T12:07:15.010 INFO:teuthology.orchestra.run.smithi071.stdout:(85/136): fuse-2.9.7-17.el8.x86_64.rpm 343 kB/s | 83 kB 00:00 2024-04-26T12:07:15.068 INFO:teuthology.orchestra.run.smithi071.stdout:(86/136): libgfortran-8.5.0-20.el8.x86_64.rpm 2.4 MB/s | 645 kB 00:00 2024-04-26T12:07:15.072 INFO:teuthology.orchestra.run.smithi104.stdout:(44/136): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2024-04-26T12:07:15.099 INFO:teuthology.orchestra.run.smithi045.stdout:(21/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 2.5 MB/s | 364 kB 00:00 2024-04-26T12:07:15.181 INFO:teuthology.orchestra.run.smithi104.stdout:(45/136): python3-cheroot-8.5.2-1.el8.noarch.rp 637 kB/s | 173 kB 00:00 2024-04-26T12:07:15.183 INFO:teuthology.orchestra.run.smithi045.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 107 kB 00:00 2024-04-26T12:07:15.206 INFO:teuthology.orchestra.run.smithi104.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 608 kB/s | 81 kB 00:00 2024-04-26T12:07:15.250 INFO:teuthology.orchestra.run.smithi045.stdout:(23/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.4 MB/s | 95 kB 00:00 2024-04-26T12:07:15.290 INFO:teuthology.orchestra.run.smithi104.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-04-26T12:07:15.310 INFO:teuthology.orchestra.run.smithi071.stdout:(87/136): libquadmath-8.5.0-20.el8.x86_64.rpm 574 kB/s | 172 kB 00:00 2024-04-26T12:07:15.315 INFO:teuthology.orchestra.run.smithi104.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2024-04-26T12:07:15.336 INFO:teuthology.orchestra.run.smithi071.stdout:(88/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 891 kB/s | 238 kB 00:00 2024-04-26T12:07:15.423 INFO:teuthology.orchestra.run.smithi104.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2024-04-26T12:07:15.532 INFO:teuthology.orchestra.run.smithi104.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 542 kB/s | 59 kB 00:00 2024-04-26T12:07:15.544 INFO:teuthology.orchestra.run.smithi071.stdout:(89/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 311 kB/s | 73 kB 00:00 2024-04-26T12:07:15.569 INFO:teuthology.orchestra.run.smithi071.stdout:(90/136): elfutils-libelf-devel-0.189-3.el8.x86 264 kB/s | 62 kB 00:00 2024-04-26T12:07:15.632 INFO:teuthology.orchestra.run.smithi104.stdout:(51/136): python3-kubernetes-11.0.0-6.el8.noarc 3.4 MB/s | 1.2 MB 00:00 2024-04-26T12:07:15.658 INFO:teuthology.orchestra.run.smithi104.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2024-04-26T12:07:15.750 INFO:teuthology.orchestra.run.smithi104.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2024-04-26T12:07:15.778 INFO:teuthology.orchestra.run.smithi071.stdout:(91/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.4 MB/s | 562 kB 00:00 2024-04-26T12:07:15.804 INFO:teuthology.orchestra.run.smithi104.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 106 kB/s | 16 kB 00:00 2024-04-26T12:07:15.853 INFO:teuthology.orchestra.run.smithi071.stdout:(92/136): openssl-devel-1.1.1k-12.el8_9.x86_64. 8.2 MB/s | 2.3 MB 00:00 2024-04-26T12:07:15.858 INFO:teuthology.orchestra.run.smithi104.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2024-04-26T12:07:15.909 INFO:teuthology.orchestra.run.smithi104.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2024-04-26T12:07:15.967 INFO:teuthology.orchestra.run.smithi104.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 591 kB/s | 64 kB 00:00 2024-04-26T12:07:16.002 INFO:teuthology.orchestra.run.smithi071.stdout:(93/136): python3-cryptography-3.2.1-7.el8_9.x8 3.7 MB/s | 559 kB 00:00 2024-04-26T12:07:16.017 INFO:teuthology.orchestra.run.smithi104.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2024-04-26T12:07:16.037 INFO:teuthology.orchestra.run.smithi071.stdout:(94/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 182 kB/s | 47 kB 00:00 2024-04-26T12:07:16.055 INFO:teuthology.orchestra.run.smithi094.stdout:(8/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el8 2.4 MB/s | 13 MB 00:05 2024-04-26T12:07:16.076 INFO:teuthology.orchestra.run.smithi104.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2024-04-26T12:07:16.127 INFO:teuthology.orchestra.run.smithi104.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2024-04-26T12:07:16.131 INFO:teuthology.orchestra.run.smithi094.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 326 kB/s | 24 kB 00:00 2024-04-26T12:07:16.179 INFO:teuthology.orchestra.run.smithi071.stdout:(95/136): python3-jsonpointer-1.10-11.el8.noarc 141 kB/s | 20 kB 00:00 2024-04-26T12:07:16.185 INFO:teuthology.orchestra.run.smithi104.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2024-04-26T12:07:16.209 INFO:teuthology.orchestra.run.smithi045.stdout:(24/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 3.6 MB/s | 3.5 MB 00:00 2024-04-26T12:07:16.221 INFO:teuthology.orchestra.run.smithi071.stdout:(96/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 456 kB/s | 100 kB 00:00 2024-04-26T12:07:16.244 INFO:teuthology.orchestra.run.smithi104.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2024-04-26T12:07:16.280 INFO:teuthology.orchestra.run.smithi071.stdout:(97/136): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2024-04-26T12:07:16.300 INFO:teuthology.orchestra.run.smithi045.stdout:(25/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 3.6 MB/s | 6.6 MB 00:01 2024-04-26T12:07:16.305 INFO:teuthology.orchestra.run.smithi071.stdout:(98/136): python3-prettytable-0.7.2-14.el8.noar 350 kB/s | 44 kB 00:00 2024-04-26T12:07:16.310 INFO:teuthology.orchestra.run.smithi104.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2024-04-26T12:07:16.326 INFO:teuthology.orchestra.run.smithi045.stdout:(26/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.5 MB/s | 181 kB 00:00 2024-04-26T12:07:16.352 INFO:teuthology.orchestra.run.smithi104.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 565 kB/s | 61 kB 00:00 2024-04-26T12:07:16.367 INFO:teuthology.orchestra.run.smithi045.stdout:(27/136): ceph-grafana-dashboards-18.2.2-1256.g 363 kB/s | 24 kB 00:00 2024-04-26T12:07:16.409 INFO:teuthology.orchestra.run.smithi045.stdout:(28/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.6 MB/s | 138 kB 00:00 2024-04-26T12:07:16.414 INFO:teuthology.orchestra.run.smithi071.stdout:(99/136): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2024-04-26T12:07:16.420 INFO:teuthology.orchestra.run.smithi104.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 784 kB/s | 85 kB 00:00 2024-04-26T12:07:16.439 INFO:teuthology.orchestra.run.smithi071.stdout:(100/136): python3-pyasn1-0.3.7-6.el8.noarch.rp 947 kB/s | 126 kB 00:00 2024-04-26T12:07:16.453 INFO:teuthology.orchestra.run.smithi104.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2024-04-26T12:07:16.470 INFO:teuthology.orchestra.run.smithi104.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-04-26T12:07:16.539 INFO:teuthology.orchestra.run.smithi071.stdout:(101/136): python3-werkzeug-0.12.2-4.el8.noarch 3.6 MB/s | 457 kB 00:00 2024-04-26T12:07:16.598 INFO:teuthology.orchestra.run.smithi071.stdout:(102/136): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-04-26T12:07:16.612 INFO:teuthology.orchestra.run.smithi104.stdout:(68/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 126 kB/s | 18 kB 00:00 2024-04-26T12:07:16.656 INFO:teuthology.orchestra.run.smithi071.stdout:(103/136): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2024-04-26T12:07:16.698 INFO:teuthology.orchestra.run.smithi104.stdout:(69/136): thrift-0.13.0-2.el8.x86_64.rpm 6.2 MB/s | 1.7 MB 00:00 2024-04-26T12:07:16.715 INFO:teuthology.orchestra.run.smithi071.stdout:(104/136): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2024-04-26T12:07:16.796 INFO:teuthology.orchestra.run.smithi104.stdout:(70/136): python3-jwt-1.6.1-2.el8.noarch.rpm 232 kB/s | 43 kB 00:00 2024-04-26T12:07:16.830 INFO:teuthology.orchestra.run.smithi104.stdout:(71/136): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2024-04-26T12:07:16.890 INFO:teuthology.orchestra.run.smithi071.stdout:(105/136): python3-markupsafe-0.23-19.el8.x86_6 166 kB/s | 39 kB 00:00 2024-04-26T12:07:16.913 INFO:teuthology.orchestra.run.smithi104.stdout:(72/136): python3-pycparser-2.14-14.el8.noarch. 934 kB/s | 109 kB 00:00 2024-04-26T12:07:16.940 INFO:teuthology.orchestra.run.smithi071.stdout:(106/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2024-04-26T12:07:16.947 INFO:teuthology.orchestra.run.smithi104.stdout:(73/136): python3-requests-oauthlib-1.0.0-1.el8 365 kB/s | 43 kB 00:00 2024-04-26T12:07:17.049 INFO:teuthology.orchestra.run.smithi071.stdout:(107/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 653 kB/s | 103 kB 00:00 2024-04-26T12:07:17.080 INFO:teuthology.orchestra.run.smithi104.stdout:(74/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 112 kB/s | 19 kB 00:00 2024-04-26T12:07:17.156 INFO:teuthology.orchestra.run.smithi104.stdout:(75/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 210 kB/s | 44 kB 00:00 2024-04-26T12:07:17.173 INFO:teuthology.orchestra.run.smithi094.stdout:(10/136): ceph-common-18.2.2-1256.gdc093b5e.el8 1.4 MB/s | 22 MB 00:15 2024-04-26T12:07:17.191 INFO:teuthology.orchestra.run.smithi071.stdout:(108/136): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2024-04-26T12:07:17.206 INFO:teuthology.orchestra.run.smithi104.stdout:(76/136): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2024-04-26T12:07:17.224 INFO:teuthology.orchestra.run.smithi071.stdout:(109/136): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2024-04-26T12:07:17.281 INFO:teuthology.orchestra.run.smithi104.stdout:(77/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-04-26T12:07:17.323 INFO:teuthology.orchestra.run.smithi104.stdout:(78/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2024-04-26T12:07:17.333 INFO:teuthology.orchestra.run.smithi071.stdout:(110/136): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-26T12:07:17.376 INFO:teuthology.orchestra.run.smithi045.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 3.5 MB/s | 3.5 MB 00:01 2024-04-26T12:07:17.382 INFO:teuthology.orchestra.run.smithi104.stdout:(79/136): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-04-26T12:07:17.415 INFO:teuthology.orchestra.run.smithi094.stdout:(11/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 2.2 MB/s | 18 MB 00:08 2024-04-26T12:07:17.425 INFO:teuthology.orchestra.run.smithi071.stdout:(111/136): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2024-04-26T12:07:17.440 INFO:teuthology.orchestra.run.smithi094.stdout:(12/136): libcephfs-devel-18.2.2-1256.gdc093b5e 116 kB/s | 31 kB 00:00 2024-04-26T12:07:17.449 INFO:teuthology.orchestra.run.smithi104.stdout:(80/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 384 kB/s | 48 kB 00:00 2024-04-26T12:07:17.450 INFO:teuthology.orchestra.run.smithi071.stdout:(112/136): python3-numpy-f2py-1.14.3-10.el8.x86 1.9 MB/s | 225 kB 00:00 2024-04-26T12:07:17.468 INFO:teuthology.orchestra.run.smithi045.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 2.6 MB/s | 246 kB 00:00 2024-04-26T12:07:17.508 INFO:teuthology.orchestra.run.smithi104.stdout:(81/136): libsepol-devel-2.9-3.el8.x86_64.rpm 695 kB/s | 87 kB 00:00 2024-04-26T12:07:17.533 INFO:teuthology.orchestra.run.smithi104.stdout:(82/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-04-26T12:07:17.543 INFO:teuthology.orchestra.run.smithi071.stdout:(113/136): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2024-04-26T12:07:17.552 INFO:teuthology.orchestra.run.smithi045.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 591 kB/s | 49 kB 00:00 2024-04-26T12:07:17.599 INFO:teuthology.orchestra.run.smithi094.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 896 kB/s | 142 kB 00:00 2024-04-26T12:07:17.635 INFO:teuthology.orchestra.run.smithi045.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 182 kB/s | 15 kB 00:00 2024-04-26T12:07:17.649 INFO:teuthology.orchestra.run.smithi104.stdout:(83/136): libcom_err-devel-1.45.6-4.el8.x86_64. 272 kB/s | 39 kB 00:00 2024-04-26T12:07:17.675 INFO:teuthology.orchestra.run.smithi104.stdout:(84/136): fuse-2.9.7-17.el8.x86_64.rpm 585 kB/s | 83 kB 00:00 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi071.stdout:(114/136): openblas-threads-0.3.15-6.el8.x86_64 23 MB/s | 5.2 MB 00:00 2024-04-26T12:07:17.677 INFO:teuthology.orchestra.run.smithi094.stdout:(14/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.9 MB/s | 781 kB 00:00 2024-04-26T12:07:17.702 INFO:teuthology.orchestra.run.smithi071.stdout:(115/136): python3-mako-1.0.6-14.el8.noarch.rpm 991 kB/s | 157 kB 00:00 2024-04-26T12:07:17.708 INFO:teuthology.orchestra.run.smithi094.stdout:(15/136): librados-devel-18.2.2-1256.gdc093b5e. 1.2 MB/s | 139 kB 00:00 2024-04-26T12:07:17.816 INFO:teuthology.orchestra.run.smithi094.stdout:(16/136): libradosstriper1-18.2.2-1256.gdc093b5 3.3 MB/s | 474 kB 00:00 2024-04-26T12:07:17.885 INFO:teuthology.orchestra.run.smithi104.stdout:(85/136): libquadmath-8.5.0-20.el8.x86_64.rpm 827 kB/s | 172 kB 00:00 2024-04-26T12:07:17.900 INFO:teuthology.orchestra.run.smithi094.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 533 kB/s | 45 kB 00:00 2024-04-26T12:07:17.926 INFO:teuthology.orchestra.run.smithi104.stdout:(86/136): libgfortran-8.5.0-20.el8.x86_64.rpm 2.3 MB/s | 645 kB 00:00 2024-04-26T12:07:17.953 INFO:teuthology.orchestra.run.smithi045.stdout:(33/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 830 kB/s | 263 kB 00:00 2024-04-26T12:07:17.975 INFO:teuthology.orchestra.run.smithi104.stdout:(87/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2024-04-26T12:07:17.992 INFO:teuthology.orchestra.run.smithi094.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 1.4 MB/s | 129 kB 00:00 2024-04-26T12:07:18.068 INFO:teuthology.orchestra.run.smithi094.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 2.6 MB/s | 197 kB 00:00 2024-04-26T12:07:18.070 INFO:teuthology.orchestra.run.smithi045.stdout:(34/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.4 MB/s | 173 kB 00:00 2024-04-26T12:07:18.143 INFO:teuthology.orchestra.run.smithi094.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 4.8 MB/s | 371 kB 00:00 2024-04-26T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stdout:(35/136): ceph-mgr-diskprediction-local-18.2.2- 4.2 MB/s | 7.4 MB 00:01 2024-04-26T12:07:18.227 INFO:teuthology.orchestra.run.smithi094.stdout:(21/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 4.3 MB/s | 364 kB 00:00 2024-04-26T12:07:18.285 INFO:teuthology.orchestra.run.smithi094.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.8 MB/s | 107 kB 00:00 2024-04-26T12:07:18.337 INFO:teuthology.orchestra.run.smithi045.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 336 kB/s | 59 kB 00:00 2024-04-26T12:07:18.370 INFO:teuthology.orchestra.run.smithi045.stdout:(37/136): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2024-04-26T12:07:18.376 INFO:teuthology.orchestra.run.smithi104.stdout:(88/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 4.0 MB/s | 47 MB 00:11 2024-04-26T12:07:18.393 INFO:teuthology.orchestra.run.smithi104.stdout:(89/136): elfutils-libelf-devel-0.189-3.el8.x86 148 kB/s | 62 kB 00:00 2024-04-26T12:07:18.420 INFO:teuthology.orchestra.run.smithi045.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 900 kB/s | 75 kB 00:00 2024-04-26T12:07:18.426 INFO:teuthology.orchestra.run.smithi104.stdout:(90/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 145 kB/s | 73 kB 00:00 2024-04-26T12:07:18.488 INFO:teuthology.orchestra.run.smithi045.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 654 kB/s | 44 kB 00:00 2024-04-26T12:07:18.513 INFO:teuthology.orchestra.run.smithi045.stdout:(40/136): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2024-04-26T12:07:18.527 INFO:teuthology.orchestra.run.smithi071.stdout:(116/136): ceph-test-18.2.2-1256.gdc093b5e.el8. 3.8 MB/s | 47 MB 00:12 2024-04-26T12:07:18.535 INFO:teuthology.orchestra.run.smithi094.stdout:(23/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 380 kB/s | 95 kB 00:00 2024-04-26T12:07:18.568 INFO:teuthology.orchestra.run.smithi104.stdout:(91/136): openssl-devel-1.1.1k-12.el8_9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-04-26T12:07:18.569 INFO:teuthology.orchestra.run.smithi071.stdout:(117/136): automake-1.16.1-8.el8.noarch.rpm 823 kB/s | 714 kB 00:00 2024-04-26T12:07:18.571 INFO:teuthology.orchestra.run.smithi045.stdout:(41/136): python3-cachetools-3.1.1-4.el8.noarch 565 kB/s | 33 kB 00:00 2024-04-26T12:07:18.594 INFO:teuthology.orchestra.run.smithi104.stdout:(92/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.5 MB/s | 562 kB 00:00 2024-04-26T12:07:18.597 INFO:teuthology.orchestra.run.smithi045.stdout:(42/136): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2024-04-26T12:07:18.619 INFO:teuthology.orchestra.run.smithi104.stdout:(93/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 245 kB/s | 47 kB 00:00 2024-04-26T12:07:18.630 INFO:teuthology.orchestra.run.smithi045.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2024-04-26T12:07:18.673 INFO:teuthology.orchestra.run.smithi045.stdout:(44/136): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2024-04-26T12:07:18.686 INFO:teuthology.orchestra.run.smithi071.stdout:(118/136): openblas-0.3.15-6.el8.x86_64.rpm 5.0 MB/s | 5.0 MB 00:01 2024-04-26T12:07:18.714 INFO:teuthology.orchestra.run.smithi045.stdout:(45/136): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2024-04-26T12:07:18.727 INFO:teuthology.orchestra.run.smithi104.stdout:(94/136): python3-packaging-16.8-9.el8.noarch.r 445 kB/s | 48 kB 00:00 2024-04-26T12:07:18.739 INFO:teuthology.orchestra.run.smithi045.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2024-04-26T12:07:18.761 INFO:teuthology.orchestra.run.smithi104.stdout:(95/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 596 kB/s | 100 kB 00:00 2024-04-26T12:07:18.766 INFO:teuthology.orchestra.run.smithi071.stdout:(119/136): jq-1.6-7.el8.x86_64.rpm 850 kB/s | 202 kB 00:00 2024-04-26T12:07:18.773 INFO:teuthology.orchestra.run.smithi045.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 188 kB/s | 11 kB 00:00 2024-04-26T12:07:18.799 INFO:teuthology.orchestra.run.smithi045.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 298 kB/s | 18 kB 00:00 2024-04-26T12:07:18.803 INFO:teuthology.orchestra.run.smithi104.stdout:(96/136): python3-cryptography-3.2.1-7.el8_9.x8 2.3 MB/s | 559 kB 00:00 2024-04-26T12:07:18.828 INFO:teuthology.orchestra.run.smithi071.stdout:(120/136): python3-pytz-2017.2-11.el8.noarch.rp 214 kB/s | 54 kB 00:00 2024-04-26T12:07:18.857 INFO:teuthology.orchestra.run.smithi045.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 838 kB/s | 49 kB 00:00 2024-04-26T12:07:18.887 INFO:teuthology.orchestra.run.smithi071.stdout:(121/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T12:07:18.891 INFO:teuthology.orchestra.run.smithi045.stdout:(50/136): python3-kubernetes-11.0.0-6.el8.noarc 10 MB/s | 1.2 MB 00:00 2024-04-26T12:07:18.895 INFO:teuthology.orchestra.run.smithi104.stdout:(97/136): python3-jsonpointer-1.10-11.el8.noarc 119 kB/s | 20 kB 00:00 2024-04-26T12:07:18.916 INFO:teuthology.orchestra.run.smithi045.stdout:(51/136): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2024-04-26T12:07:18.929 INFO:teuthology.orchestra.run.smithi104.stdout:(98/136): python3-pyasn1-modules-0.3.7-6.el8.no 881 kB/s | 110 kB 00:00 2024-04-26T12:07:18.950 INFO:teuthology.orchestra.run.smithi045.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2024-04-26T12:07:18.970 INFO:teuthology.orchestra.run.smithi104.stdout:(99/136): python3-prettytable-0.7.2-14.el8.noar 210 kB/s | 44 kB 00:00 2024-04-26T12:07:18.992 INFO:teuthology.orchestra.run.smithi045.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2024-04-26T12:07:18.994 INFO:teuthology.orchestra.run.smithi094.stdout:(24/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 5.1 MB/s | 6.6 MB 00:01 2024-04-26T12:07:19.012 INFO:teuthology.orchestra.run.smithi104.stdout:(100/136): python3-jsonpatch-1.21-2.el8.noarch. 226 kB/s | 27 kB 00:00 2024-04-26T12:07:19.017 INFO:teuthology.orchestra.run.smithi045.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2024-04-26T12:07:19.046 INFO:teuthology.orchestra.run.smithi104.stdout:(101/136): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2024-04-26T12:07:19.051 INFO:teuthology.orchestra.run.smithi045.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 576 kB/s | 34 kB 00:00 2024-04-26T12:07:19.053 INFO:teuthology.orchestra.run.smithi094.stdout:(25/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 6.7 MB/s | 3.5 MB 00:00 2024-04-26T12:07:19.084 INFO:teuthology.orchestra.run.smithi045.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2024-04-26T12:07:19.096 INFO:teuthology.orchestra.run.smithi104.stdout:(102/136): python3-werkzeug-0.12.2-4.el8.noarch 3.6 MB/s | 457 kB 00:00 2024-04-26T12:07:19.120 INFO:teuthology.orchestra.run.smithi094.stdout:(26/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.4 MB/s | 181 kB 00:00 2024-04-26T12:07:19.126 INFO:teuthology.orchestra.run.smithi045.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 854 kB/s | 64 kB 00:00 2024-04-26T12:07:19.143 INFO:teuthology.orchestra.run.smithi045.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 319 kB/s | 19 kB 00:00 2024-04-26T12:07:19.145 INFO:teuthology.orchestra.run.smithi094.stdout:(27/136): ceph-grafana-dashboards-18.2.2-1256.g 264 kB/s | 24 kB 00:00 2024-04-26T12:07:19.155 INFO:teuthology.orchestra.run.smithi104.stdout:(103/136): bison-3.0.4-10.el8.x86_64.rpm 4.7 MB/s | 688 kB 00:00 2024-04-26T12:07:19.177 INFO:teuthology.orchestra.run.smithi045.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 476 kB/s | 24 kB 00:00 2024-04-26T12:07:19.179 INFO:teuthology.orchestra.run.smithi094.stdout:(28/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.3 MB/s | 138 kB 00:00 2024-04-26T12:07:19.180 INFO:teuthology.orchestra.run.smithi104.stdout:(104/136): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2024-04-26T12:07:19.202 INFO:teuthology.orchestra.run.smithi045.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 507 kB/s | 29 kB 00:00 2024-04-26T12:07:19.228 INFO:teuthology.orchestra.run.smithi045.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2024-04-26T12:07:19.262 INFO:teuthology.orchestra.run.smithi071.stdout:(122/136): python3-scipy-1.0.0-21.module+el8.9. 24 MB/s | 14 MB 00:00 2024-04-26T12:07:19.278 INFO:teuthology.orchestra.run.smithi045.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2024-04-26T12:07:19.303 INFO:teuthology.orchestra.run.smithi045.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2024-04-26T12:07:19.314 INFO:teuthology.orchestra.run.smithi104.stdout:(105/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2024-04-26T12:07:19.328 INFO:teuthology.orchestra.run.smithi045.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2024-04-26T12:07:19.356 INFO:teuthology.orchestra.run.smithi104.stdout:(106/136): libtool-2.4.6-25.el8.x86_64.rpm 2.7 MB/s | 709 kB 00:00 2024-04-26T12:07:19.362 INFO:teuthology.orchestra.run.smithi045.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2024-04-26T12:07:19.379 INFO:teuthology.orchestra.run.smithi045.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 455 kB/s | 23 kB 00:00 2024-04-26T12:07:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-04-26T12:07:19.431 INFO:teuthology.orchestra.run.smithi104.stdout:(107/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 887 kB/s | 103 kB 00:00 2024-04-26T12:07:19.456 INFO:teuthology.orchestra.run.smithi104.stdout:(108/136): python3-markupsafe-0.23-19.el8.x86_6 129 kB/s | 39 kB 00:00 2024-04-26T12:07:19.480 INFO:teuthology.orchestra.run.smithi045.stdout:(68/136): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2024-04-26T12:07:19.545 INFO:teuthology.orchestra.run.smithi071.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 820 kB/s | 232 kB 00:00 2024-04-26T12:07:19.573 INFO:teuthology.orchestra.run.smithi104.stdout:(109/136): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2024-04-26T12:07:19.607 INFO:teuthology.orchestra.run.smithi104.stdout:(110/136): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2024-04-26T12:07:19.612 INFO:teuthology.orchestra.run.smithi071.stdout:(124/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 4.9 MB/s | 3.6 MB 00:00 2024-04-26T12:07:19.638 INFO:teuthology.orchestra.run.smithi045.stdout:(69/136): python3-packaging-16.8-9.el8.noarch.r 206 kB/s | 48 kB 00:00 2024-04-26T12:07:19.691 INFO:teuthology.orchestra.run.smithi104.stdout:(111/136): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2024-04-26T12:07:19.693 INFO:teuthology.orchestra.run.smithi045.stdout:(70/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 84 kB/s | 18 kB 00:00 2024-04-26T12:07:19.696 INFO:teuthology.orchestra.run.smithi094.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.4 MB/s | 3.5 MB 00:00 2024-04-26T12:07:19.724 INFO:teuthology.orchestra.run.smithi104.stdout:(112/136): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-04-26T12:07:19.749 INFO:teuthology.orchestra.run.smithi104.stdout:(113/136): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-04-26T12:07:19.779 INFO:teuthology.orchestra.run.smithi071.stdout:(125/136): elfutils-libs-0.189-3.el8.x86_64.rpm 1.3 MB/s | 303 kB 00:00 2024-04-26T12:07:19.796 INFO:teuthology.orchestra.run.smithi094.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 2.4 MB/s | 246 kB 00:00 2024-04-26T12:07:19.808 INFO:teuthology.orchestra.run.smithi104.stdout:(114/136): librdkafka-0.11.4-3.el8.x86_64.rpm 2.9 MB/s | 354 kB 00:00 2024-04-26T12:07:19.814 INFO:teuthology.orchestra.run.smithi045.stdout:(71/136): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2024-04-26T12:07:19.889 INFO:teuthology.orchestra.run.smithi094.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 536 kB/s | 49 kB 00:00 2024-04-26T12:07:19.950 INFO:teuthology.orchestra.run.smithi104.stdout:(115/136): openblas-threads-0.3.15-6.el8.x86_64 23 MB/s | 5.2 MB 00:00 2024-04-26T12:07:19.963 INFO:teuthology.orchestra.run.smithi094.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 203 kB/s | 15 kB 00:00 2024-04-26T12:07:19.964 INFO:teuthology.orchestra.run.smithi045.stdout:(72/136): python3-jwt-1.6.1-2.el8.noarch.rpm 131 kB/s | 43 kB 00:00 2024-04-26T12:07:19.975 INFO:teuthology.orchestra.run.smithi104.stdout:(116/136): python3-mako-1.0.6-14.el8.noarch.rpm 697 kB/s | 157 kB 00:00 2024-04-26T12:07:19.989 INFO:teuthology.orchestra.run.smithi045.stdout:(73/136): python3-pycparser-2.14-14.el8.noarch. 623 kB/s | 109 kB 00:00 2024-04-26T12:07:20.004 INFO:teuthology.orchestra.run.smithi071.stdout:(126/136): librados2-18.2.2-1256.gdc093b5e.el8. 3.1 MB/s | 3.7 MB 00:01 2024-04-26T12:07:20.038 INFO:teuthology.orchestra.run.smithi071.stdout:(127/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 5.7 MB/s | 1.5 MB 00:00 2024-04-26T12:07:20.048 INFO:teuthology.orchestra.run.smithi045.stdout:(74/136): python3-requests-oauthlib-1.0.0-1.el8 509 kB/s | 43 kB 00:00 2024-04-26T12:07:20.056 INFO:teuthology.orchestra.run.smithi094.stdout:(33/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.8 MB/s | 263 kB 00:00 2024-04-26T12:07:20.074 INFO:teuthology.orchestra.run.smithi045.stdout:(75/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 223 kB/s | 19 kB 00:00 2024-04-26T12:07:20.122 INFO:teuthology.orchestra.run.smithi071.stdout:(128/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 1.4 MB/s | 711 kB 00:00 2024-04-26T12:07:20.125 INFO:teuthology.orchestra.run.smithi104.stdout:(117/136): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-04-26T12:07:20.139 INFO:teuthology.orchestra.run.smithi094.stdout:(34/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 2.0 MB/s | 173 kB 00:00 2024-04-26T12:07:20.151 INFO:teuthology.orchestra.run.smithi104.stdout:(118/136): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2024-04-26T12:07:20.209 INFO:teuthology.orchestra.run.smithi104.stdout:(119/136): python3-pytz-2017.2-11.el8.noarch.rp 649 kB/s | 54 kB 00:00 2024-04-26T12:07:20.222 INFO:teuthology.orchestra.run.smithi071.stdout:(129/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.9 MB/s | 1.1 MB 00:00 2024-04-26T12:07:20.239 INFO:teuthology.orchestra.run.smithi071.stdout:(130/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 221 kB 00:00 2024-04-26T12:07:20.283 INFO:teuthology.orchestra.run.smithi045.stdout:(76/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 188 kB/s | 44 kB 00:00 2024-04-26T12:07:20.301 INFO:teuthology.orchestra.run.smithi104.stdout:(120/136): openblas-0.3.15-6.el8.x86_64.rpm 10 MB/s | 5.0 MB 00:00 2024-04-26T12:07:20.341 INFO:teuthology.orchestra.run.smithi045.stdout:(77/136): pcre2-devel-10.32-2.el8.x86_64.rpm 2.2 MB/s | 605 kB 00:00 2024-04-26T12:07:20.343 INFO:teuthology.orchestra.run.smithi104.stdout:(121/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-26T12:07:20.430 INFO:teuthology.orchestra.run.smithi071.stdout:(131/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 237 kB 00:00 2024-04-26T12:07:20.440 INFO:teuthology.orchestra.run.smithi094.stdout:(35/136): ceph-mgr-diskprediction-local-18.2.2- 5.9 MB/s | 7.4 MB 00:01 2024-04-26T12:07:20.456 INFO:teuthology.orchestra.run.smithi071.stdout:(132/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 829 kB/s | 180 kB 00:00 2024-04-26T12:07:20.500 INFO:teuthology.orchestra.run.smithi045.stdout:(78/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2024-04-26T12:07:20.542 INFO:teuthology.orchestra.run.smithi045.stdout:(79/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 885 kB/s | 229 kB 00:00 2024-04-26T12:07:20.564 INFO:teuthology.orchestra.run.smithi071.stdout:(133/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 574 kB/s | 254 kB 00:00 2024-04-26T12:07:20.565 INFO:teuthology.orchestra.run.smithi094.stdout:(36/136): gperftools-libs-2.7-9.el8.x86_64.rpm 720 kB/s | 306 kB 00:00 2024-04-26T12:07:20.625 INFO:teuthology.orchestra.run.smithi045.stdout:(80/136): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-04-26T12:07:20.651 INFO:teuthology.orchestra.run.smithi104.stdout:(122/136): python3-scipy-1.0.0-21.module+el8.9. 27 MB/s | 14 MB 00:00 2024-04-26T12:07:20.677 INFO:teuthology.orchestra.run.smithi094.stdout:(37/136): libunwind-1.3.1-3.el8.x86_64.rpm 679 kB/s | 75 kB 00:00 2024-04-26T12:07:20.689 INFO:teuthology.orchestra.run.smithi071.stdout:(134/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 383 kB/s | 99 kB 00:00 2024-04-26T12:07:20.742 INFO:teuthology.orchestra.run.smithi045.stdout:(81/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 240 kB/s | 48 kB 00:00 2024-04-26T12:07:20.749 INFO:teuthology.orchestra.run.smithi094.stdout:(38/136): liboath-2.6.2-3.el8.x86_64.rpm 190 kB/s | 59 kB 00:00 2024-04-26T12:07:20.792 INFO:teuthology.orchestra.run.smithi045.stdout:(82/136): libsepol-devel-2.9-3.el8.x86_64.rpm 521 kB/s | 87 kB 00:00 2024-04-26T12:07:20.808 INFO:teuthology.orchestra.run.smithi094.stdout:(39/136): python3-asyncssh-2.7.0-2.el8.noarch.r 3.6 MB/s | 476 kB 00:00 2024-04-26T12:07:20.818 INFO:teuthology.orchestra.run.smithi104.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-04-26T12:07:20.850 INFO:teuthology.orchestra.run.smithi094.stdout:(40/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 434 kB/s | 44 kB 00:00 2024-04-26T12:07:20.865 INFO:teuthology.orchestra.run.smithi071.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 6.1 MB/s | 2.5 MB 00:00 2024-04-26T12:07:20.876 INFO:teuthology.orchestra.run.smithi045.stdout:(83/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 432 kB/s | 58 kB 00:00 2024-04-26T12:07:20.881 INFO:teuthology.orchestra.run.smithi071.stdout:(136/136): util-linux-user-2.32.1-44.el8_9.1.x8 324 kB/s | 103 kB 00:00 2024-04-26T12:07:20.885 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:07:20.885 INFO:teuthology.orchestra.run.smithi071.stdout:Total 11 MB/s | 206 MB 00:19 2024-04-26T12:07:20.892 INFO:teuthology.orchestra.run.smithi094.stdout:(41/136): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2024-04-26T12:07:20.935 INFO:teuthology.orchestra.run.smithi045.stdout:(84/136): libcom_err-devel-1.45.6-4.el8.x86_64. 272 kB/s | 39 kB 00:00 2024-04-26T12:07:20.951 INFO:teuthology.orchestra.run.smithi094.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 329 kB/s | 33 kB 00:00 2024-04-26T12:07:20.960 INFO:teuthology.orchestra.run.smithi104.stdout:(124/136): librados2-18.2.2-1256.gdc093b5e.el8. 5.6 MB/s | 3.7 MB 00:00 2024-04-26T12:07:20.976 INFO:teuthology.orchestra.run.smithi094.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 194 kB/s | 16 kB 00:00 2024-04-26T12:07:20.985 INFO:teuthology.orchestra.run.smithi104.stdout:(125/136): elfutils-libs-0.189-3.el8.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2024-04-26T12:07:21.035 INFO:teuthology.orchestra.run.smithi045.stdout:(85/136): fuse-2.9.7-17.el8.x86_64.rpm 523 kB/s | 83 kB 00:00 2024-04-26T12:07:21.068 INFO:teuthology.orchestra.run.smithi094.stdout:(44/136): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2024-04-26T12:07:21.077 INFO:teuthology.orchestra.run.smithi045.stdout:(86/136): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2024-04-26T12:07:21.118 INFO:teuthology.orchestra.run.smithi094.stdout:(45/136): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2024-04-26T12:07:21.119 INFO:teuthology.orchestra.run.smithi104.stdout:(126/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.4 MB/s | 711 kB 00:00 2024-04-26T12:07:21.144 INFO:teuthology.orchestra.run.smithi094.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2024-04-26T12:07:21.169 INFO:teuthology.orchestra.run.smithi045.stdout:(87/136): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-04-26T12:07:21.175 INFO:teuthology.orchestra.run.smithi104.stdout:(127/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.8 MB/s | 1.5 MB 00:00 2024-04-26T12:07:21.202 INFO:teuthology.orchestra.run.smithi045.stdout:(88/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-04-26T12:07:21.211 INFO:teuthology.orchestra.run.smithi094.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2024-04-26T12:07:21.220 INFO:teuthology.orchestra.run.smithi104.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-04-26T12:07:21.236 INFO:teuthology.orchestra.run.smithi094.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-04-26T12:07:21.269 INFO:teuthology.orchestra.run.smithi045.stdout:(89/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 726 kB/s | 73 kB 00:00 2024-04-26T12:07:21.286 INFO:teuthology.orchestra.run.smithi104.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.9 MB/s | 221 kB 00:00 2024-04-26T12:07:21.312 INFO:teuthology.orchestra.run.smithi094.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 649 kB/s | 49 kB 00:00 2024-04-26T12:07:21.312 INFO:teuthology.orchestra.run.smithi104.stdout:(130/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.7 MB/s | 254 kB 00:00 2024-04-26T12:07:21.345 INFO:teuthology.orchestra.run.smithi045.stdout:(90/136): elfutils-libelf-devel-0.189-3.el8.x86 435 kB/s | 62 kB 00:00 2024-04-26T12:07:21.379 INFO:teuthology.orchestra.run.smithi045.stdout:(91/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 5.1 MB/s | 562 kB 00:00 2024-04-26T12:07:21.387 INFO:teuthology.orchestra.run.smithi094.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 785 kB/s | 59 kB 00:00 2024-04-26T12:07:21.412 INFO:teuthology.orchestra.run.smithi104.stdout:(131/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.8 MB/s | 180 kB 00:00 2024-04-26T12:07:21.446 INFO:teuthology.orchestra.run.smithi104.stdout:(132/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 237 kB 00:00 2024-04-26T12:07:21.471 INFO:teuthology.orchestra.run.smithi094.stdout:(51/136): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2024-04-26T12:07:21.496 INFO:teuthology.orchestra.run.smithi094.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2024-04-26T12:07:21.513 INFO:teuthology.orchestra.run.smithi104.stdout:(133/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 3.0 MB/s | 3.6 MB 00:01 2024-04-26T12:07:21.520 INFO:teuthology.orchestra.run.smithi045.stdout:(92/136): openssl-devel-1.1.1k-12.el8_9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-04-26T12:07:21.538 INFO:teuthology.orchestra.run.smithi104.stdout:(134/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 790 kB/s | 99 kB 00:00 2024-04-26T12:07:21.554 INFO:teuthology.orchestra.run.smithi094.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2024-04-26T12:07:21.580 INFO:teuthology.orchestra.run.smithi094.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2024-04-26T12:07:21.605 INFO:teuthology.orchestra.run.smithi104.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 16 MB/s | 2.5 MB 00:00 2024-04-26T12:07:21.630 INFO:teuthology.orchestra.run.smithi104.stdout:(136/136): util-linux-user-2.32.1-44.el8_9.1.x8 880 kB/s | 103 kB 00:00 2024-04-26T12:07:21.630 INFO:teuthology.orchestra.run.smithi094.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2024-04-26T12:07:21.633 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:07:21.633 INFO:teuthology.orchestra.run.smithi104.stdout:Total 10 MB/s | 206 MB 00:19 2024-04-26T12:07:21.647 INFO:teuthology.orchestra.run.smithi094.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2024-04-26T12:07:21.723 INFO:teuthology.orchestra.run.smithi094.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 698 kB/s | 64 kB 00:00 2024-04-26T12:07:21.748 INFO:teuthology.orchestra.run.smithi094.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2024-04-26T12:07:21.798 INFO:teuthology.orchestra.run.smithi094.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2024-04-26T12:07:21.815 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-04-26T12:07:21.823 INFO:teuthology.orchestra.run.smithi094.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2024-04-26T12:07:21.866 INFO:teuthology.orchestra.run.smithi094.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 412 kB/s | 27 kB 00:00 2024-04-26T12:07:21.908 INFO:teuthology.orchestra.run.smithi094.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-04-26T12:07:21.971 INFO:teuthology.orchestra.run.smithi045.stdout:(93/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 5.5 MB/s | 47 MB 00:08 2024-04-26T12:07:21.983 INFO:teuthology.orchestra.run.smithi094.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2024-04-26T12:07:21.996 INFO:teuthology.orchestra.run.smithi045.stdout:(94/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-04-26T12:07:22.000 INFO:teuthology.orchestra.run.smithi094.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 664 kB/s | 61 kB 00:00 2024-04-26T12:07:22.059 INFO:teuthology.orchestra.run.smithi094.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-04-26T12:07:22.063 INFO:teuthology.orchestra.run.smithi045.stdout:(95/136): python3-cryptography-3.2.1-7.el8_9.x8 1.0 MB/s | 559 kB 00:00 2024-04-26T12:07:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2024-04-26T12:07:22.096 INFO:teuthology.orchestra.run.smithi045.stdout:(96/136): python3-jsonpointer-1.10-11.el8.noarc 219 kB/s | 20 kB 00:00 2024-04-26T12:07:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-04-26T12:07:22.147 INFO:teuthology.orchestra.run.smithi045.stdout:(97/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 569 kB/s | 100 kB 00:00 2024-04-26T12:07:22.180 INFO:teuthology.orchestra.run.smithi045.stdout:(98/136): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2024-04-26T12:07:22.201 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-04-26T12:07:22.202 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-04-26T12:07:22.230 INFO:teuthology.orchestra.run.smithi045.stdout:(99/136): python3-prettytable-0.7.2-14.el8.noar 263 kB/s | 44 kB 00:00 2024-04-26T12:07:22.243 INFO:teuthology.orchestra.run.smithi094.stdout:(68/136): thrift-0.13.0-2.el8.x86_64.rpm 9.4 MB/s | 1.7 MB 00:00 2024-04-26T12:07:22.269 INFO:teuthology.orchestra.run.smithi094.stdout:(69/136): python3-jsonpointer-1.10-11.el8.noarc 120 kB/s | 20 kB 00:00 2024-04-26T12:07:22.322 INFO:teuthology.orchestra.run.smithi045.stdout:(100/136): python3-pyasn1-0.3.7-6.el8.noarch.rp 891 kB/s | 126 kB 00:00 2024-04-26T12:07:22.348 INFO:teuthology.orchestra.run.smithi045.stdout:(101/136): python3-jsonpatch-1.21-2.el8.noarch. 132 kB/s | 27 kB 00:00 2024-04-26T12:07:22.390 INFO:teuthology.orchestra.run.smithi045.stdout:(102/136): python3-werkzeug-0.12.2-4.el8.noarch 2.8 MB/s | 457 kB 00:00 2024-04-26T12:07:22.448 INFO:teuthology.orchestra.run.smithi045.stdout:(103/136): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2024-04-26T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stdout:(104/136): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-04-26T12:07:22.524 INFO:teuthology.orchestra.run.smithi045.stdout:(105/136): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2024-04-26T12:07:22.564 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-26T12:07:22.591 INFO:teuthology.orchestra.run.smithi045.stdout:(106/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-04-26T12:07:22.641 INFO:teuthology.orchestra.run.smithi045.stdout:(107/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 887 kB/s | 103 kB 00:00 2024-04-26T12:07:22.666 INFO:teuthology.orchestra.run.smithi045.stdout:(108/136): python3-markupsafe-0.23-19.el8.x86_6 178 kB/s | 39 kB 00:00 2024-04-26T12:07:22.800 INFO:teuthology.orchestra.run.smithi045.stdout:(109/136): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2024-04-26T12:07:22.819 INFO:teuthology.orchestra.run.smithi094.stdout:(70/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 7.1 MB/s | 47 MB 00:06 2024-04-26T12:07:22.834 INFO:teuthology.orchestra.run.smithi045.stdout:(110/136): python3-jinja2-2.10.1-3.el8.noarch.r 2.7 MB/s | 538 kB 00:00 2024-04-26T12:07:22.844 INFO:teuthology.orchestra.run.smithi094.stdout:(71/136): python3-prettytable-0.7.2-14.el8.noar 73 kB/s | 44 kB 00:00 2024-04-26T12:07:22.870 INFO:teuthology.orchestra.run.smithi094.stdout:(72/136): python3-pyasn1-modules-0.3.7-6.el8.no 185 kB/s | 110 kB 00:00 2024-04-26T12:07:22.926 INFO:teuthology.orchestra.run.smithi045.stdout:(111/136): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-04-26T12:07:22.951 INFO:teuthology.orchestra.run.smithi045.stdout:(112/136): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-04-26T12:07:22.951 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-26T12:07:22.951 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-26T12:07:22.985 INFO:teuthology.orchestra.run.smithi045.stdout:(113/136): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-04-26T12:07:22.987 INFO:teuthology.orchestra.run.smithi094.stdout:(73/136): python3-jsonpatch-1.21-2.el8.noarch.r 159 kB/s | 27 kB 00:00 2024-04-26T12:07:23.020 INFO:teuthology.orchestra.run.smithi094.stdout:(74/136): python3-werkzeug-0.12.2-4.el8.noarch. 3.0 MB/s | 457 kB 00:00 2024-04-26T12:07:23.052 INFO:teuthology.orchestra.run.smithi045.stdout:(114/136): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2024-04-26T12:07:23.079 INFO:teuthology.orchestra.run.smithi094.stdout:(75/136): python3-pyasn1-0.3.7-6.el8.noarch.rpm 552 kB/s | 126 kB 00:00 2024-04-26T12:07:23.110 INFO:teuthology.orchestra.run.smithi045.stdout:(115/136): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-04-26T12:07:23.146 INFO:teuthology.orchestra.run.smithi094.stdout:(76/136): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-04-26T12:07:23.221 INFO:teuthology.orchestra.run.smithi094.stdout:(77/136): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-04-26T12:07:23.247 INFO:teuthology.orchestra.run.smithi094.stdout:(78/136): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2024-04-26T12:07:23.269 INFO:teuthology.orchestra.run.smithi045.stdout:(116/136): openblas-threads-0.3.15-6.el8.x86_64 16 MB/s | 5.2 MB 00:00 2024-04-26T12:07:23.311 INFO:teuthology.orchestra.run.smithi045.stdout:(117/136): automake-1.16.1-8.el8.noarch.rpm 3.5 MB/s | 714 kB 00:00 2024-04-26T12:07:23.330 INFO:teuthology.orchestra.run.smithi094.stdout:(79/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-04-26T12:07:23.331 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-04-26T12:07:23.342 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-04-26T12:07:23.356 INFO:teuthology.orchestra.run.smithi094.stdout:(80/136): python3-markupsafe-0.23-19.el8.x86_64 185 kB/s | 39 kB 00:00 2024-04-26T12:07:23.381 INFO:teuthology.orchestra.run.smithi094.stdout:(81/136): python3-pyOpenSSL-19.0.0-1.el8.noarch 772 kB/s | 103 kB 00:00 2024-04-26T12:07:23.419 INFO:teuthology.orchestra.run.smithi045.stdout:(118/136): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2024-04-26T12:07:23.444 INFO:teuthology.orchestra.run.smithi045.stdout:(119/136): python3-pytz-2017.2-11.el8.noarch.rp 407 kB/s | 54 kB 00:00 2024-04-26T12:07:23.523 INFO:teuthology.orchestra.run.smithi094.stdout:(82/136): python3-jinja2-2.10.1-3.el8.noarch.rp 3.1 MB/s | 538 kB 00:00 2024-04-26T12:07:23.561 INFO:teuthology.orchestra.run.smithi045.stdout:(120/136): openblas-0.3.15-6.el8.x86_64.rpm 9.9 MB/s | 5.0 MB 00:00 2024-04-26T12:07:23.612 INFO:teuthology.orchestra.run.smithi045.stdout:(121/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-04-26T12:07:23.624 INFO:teuthology.orchestra.run.smithi094.stdout:(83/136): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2024-04-26T12:07:23.657 INFO:teuthology.orchestra.run.smithi094.stdout:(84/136): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-04-26T12:07:23.732 INFO:teuthology.orchestra.run.smithi094.stdout:(85/136): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2024-04-26T12:07:23.758 INFO:teuthology.orchestra.run.smithi094.stdout:(86/136): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2024-04-26T12:07:23.858 INFO:teuthology.orchestra.run.smithi094.stdout:(87/136): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2024-04-26T12:07:23.892 INFO:teuthology.orchestra.run.smithi094.stdout:(88/136): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-04-26T12:07:23.895 INFO:teuthology.orchestra.run.smithi045.stdout:(122/136): python3-scipy-1.0.0-21.module+el8.9. 29 MB/s | 14 MB 00:00 2024-04-26T12:07:24.012 INFO:teuthology.orchestra.run.smithi045.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2024-04-26T12:07:24.067 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-26T12:07:24.077 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-26T12:07:24.104 INFO:teuthology.orchestra.run.smithi045.stdout:(124/136): elfutils-libs-0.189-3.el8.x86_64.rpm 3.2 MB/s | 303 kB 00:00 2024-04-26T12:07:24.126 INFO:teuthology.orchestra.run.smithi094.stdout:(89/136): openblas-threads-0.3.15-6.el8.x86_64. 13 MB/s | 5.2 MB 00:00 2024-04-26T12:07:24.163 INFO:teuthology.orchestra.run.smithi045.stdout:(125/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 6.5 MB/s | 3.6 MB 00:00 2024-04-26T12:07:24.167 INFO:teuthology.orchestra.run.smithi094.stdout:(90/136): automake-1.16.1-8.el8.noarch.rpm 2.5 MB/s | 714 kB 00:00 2024-04-26T12:07:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:(126/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 6.4 MB/s | 711 kB 00:00 2024-04-26T12:07:24.285 INFO:teuthology.orchestra.run.smithi094.stdout:(91/136): openblas-0.3.15-6.el8.x86_64.rpm 12 MB/s | 5.0 MB 00:00 2024-04-26T12:07:24.301 INFO:teuthology.orchestra.run.smithi094.stdout:(92/136): python3-pytz-2017.2-11.el8.noarch.rpm 406 kB/s | 54 kB 00:00 2024-04-26T12:07:24.338 INFO:teuthology.orchestra.run.smithi045.stdout:(127/136): librados2-18.2.2-1256.gdc093b5e.el8. 4.8 MB/s | 3.7 MB 00:00 2024-04-26T12:07:24.356 INFO:teuthology.orchestra.run.smithi094.stdout:(93/136): jq-1.6-7.el8.x86_64.rpm 882 kB/s | 202 kB 00:00 2024-04-26T12:07:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.8 MB/s | 1.1 MB 00:00 2024-04-26T12:07:24.427 INFO:teuthology.orchestra.run.smithi094.stdout:(94/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T12:07:24.430 INFO:teuthology.orchestra.run.smithi045.stdout:(129/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 5.5 MB/s | 1.5 MB 00:00 2024-04-26T12:07:24.447 INFO:teuthology.orchestra.run.smithi045.stdout:(130/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 2.0 MB/s | 221 kB 00:00 2024-04-26T12:07:24.531 INFO:teuthology.orchestra.run.smithi045.stdout:(131/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.9 MB/s | 254 kB 00:00 2024-04-26T12:07:24.536 INFO:teuthology.orchestra.run.smithi094.stdout:(95/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 165 kB/s | 18 kB 00:00 2024-04-26T12:07:24.561 INFO:teuthology.orchestra.run.smithi094.stdout:(96/136): python3-packaging-16.8-9.el8.noarch.r 235 kB/s | 48 kB 00:00 2024-04-26T12:07:24.581 INFO:teuthology.orchestra.run.smithi045.stdout:(132/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 237 kB 00:00 2024-04-26T12:07:24.598 INFO:teuthology.orchestra.run.smithi045.stdout:(133/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-04-26T12:07:24.645 INFO:teuthology.orchestra.run.smithi094.stdout:(97/136): python3-jwt-1.6.1-2.el8.noarch.rpm 393 kB/s | 43 kB 00:00 2024-04-26T12:07:24.699 INFO:teuthology.orchestra.run.smithi045.stdout:(134/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 591 kB/s | 99 kB 00:00 2024-04-26T12:07:24.740 INFO:teuthology.orchestra.run.smithi045.stdout:(135/136): util-linux-user-2.32.1-44.el8_9.1.x8 726 kB/s | 103 kB 00:00 2024-04-26T12:07:24.791 INFO:teuthology.orchestra.run.smithi045.stdout:(136/136): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-04-26T12:07:24.794 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:07:24.794 INFO:teuthology.orchestra.run.smithi045.stdout:Total 11 MB/s | 206 MB 00:19 2024-04-26T12:07:24.795 INFO:teuthology.orchestra.run.smithi094.stdout:(98/136): python3-scipy-1.0.0-21.module+el8.9.0 27 MB/s | 14 MB 00:00 2024-04-26T12:07:24.820 INFO:teuthology.orchestra.run.smithi094.stdout:(99/136): python3-pycparser-2.14-14.el8.noarch. 623 kB/s | 109 kB 00:00 2024-04-26T12:07:24.881 INFO:teuthology.orchestra.run.smithi094.stdout:(100/136): python3-oauthlib-2.1.0-1.el8.noarch. 485 kB/s | 155 kB 00:00 2024-04-26T12:07:24.971 INFO:teuthology.orchestra.run.smithi094.stdout:(101/136): python3-requests-oauthlib-1.0.0-1.el 243 kB/s | 43 kB 00:00 2024-04-26T12:07:25.013 INFO:teuthology.orchestra.run.smithi094.stdout:(102/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 335 kB/s | 44 kB 00:00 2024-04-26T12:07:25.038 INFO:teuthology.orchestra.run.smithi094.stdout:(103/136): libaio-devel-0.3.112-1.el8.x86_64.rp 86 kB/s | 19 kB 00:00 2024-04-26T12:07:25.081 INFO:teuthology.orchestra.run.smithi094.stdout:(104/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2024-04-26T12:07:25.127 INFO:teuthology.orchestra.run.smithi094.stdout:(105/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.4 MB/s | 220 kB 00:00 2024-04-26T12:07:25.164 INFO:teuthology.orchestra.run.smithi094.stdout:(106/136): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2024-04-26T12:07:25.206 INFO:teuthology.orchestra.run.smithi094.stdout:(107/136): libselinux-devel-2.9-5.el8.x86_64.rp 1.6 MB/s | 200 kB 00:00 2024-04-26T12:07:25.282 INFO:teuthology.orchestra.run.smithi094.stdout:(108/136): keyutils-libs-devel-1.5.10-9.el8.x86 311 kB/s | 48 kB 00:00 2024-04-26T12:07:25.315 INFO:teuthology.orchestra.run.smithi094.stdout:(109/136): zlib-devel-1.2.11-18.el8_5.x86_64.rp 531 kB/s | 58 kB 00:00 2024-04-26T12:07:25.349 INFO:teuthology.orchestra.run.smithi094.stdout:(110/136): libsepol-devel-2.9-3.el8.x86_64.rpm 471 kB/s | 87 kB 00:00 2024-04-26T12:07:25.408 INFO:teuthology.orchestra.run.smithi094.stdout:(111/136): libcom_err-devel-1.45.6-4.el8.x86_64 307 kB/s | 39 kB 00:00 2024-04-26T12:07:25.433 INFO:teuthology.orchestra.run.smithi094.stdout:(112/136): fuse-2.9.7-17.el8.x86_64.rpm 706 kB/s | 83 kB 00:00 2024-04-26T12:07:25.467 INFO:teuthology.orchestra.run.smithi094.stdout:(113/136): libgfortran-8.5.0-20.el8.x86_64.rpm 5.4 MB/s | 645 kB 00:00 2024-04-26T12:07:25.542 INFO:teuthology.orchestra.run.smithi094.stdout:(114/136): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-04-26T12:07:25.568 INFO:teuthology.orchestra.run.smithi094.stdout:(115/136): xfsprogs-devel-5.0.0-12.el8.x86_64.r 723 kB/s | 73 kB 00:00 2024-04-26T12:07:25.601 INFO:teuthology.orchestra.run.smithi094.stdout:(116/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.4 MB/s | 238 kB 00:00 2024-04-26T12:07:25.677 INFO:teuthology.orchestra.run.smithi094.stdout:(117/136): elfutils-libelf-devel-0.189-3.el8.x8 461 kB/s | 62 kB 00:00 2024-04-26T12:07:25.710 INFO:teuthology.orchestra.run.smithi094.stdout:(118/136): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.9 MB/s | 562 kB 00:00 2024-04-26T12:07:25.777 INFO:teuthology.orchestra.run.smithi094.stdout:(119/136): openssl-devel-1.1.1k-12.el8_9.x86_64 13 MB/s | 2.3 MB 00:00 2024-04-26T12:07:25.806 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-04-26T12:07:25.844 INFO:teuthology.orchestra.run.smithi094.stdout:(120/136): python3-cryptography-3.2.1-7.el8_9.x 4.1 MB/s | 559 kB 00:00 2024-04-26T12:07:25.870 INFO:teuthology.orchestra.run.smithi094.stdout:(121/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 244 kB/s | 47 kB 00:00 2024-04-26T12:07:26.012 INFO:teuthology.orchestra.run.smithi094.stdout:(122/136): libuuid-devel-2.32.1-44.el8_9.1.x86_ 426 kB/s | 100 kB 00:00 2024-04-26T12:07:26.179 INFO:teuthology.orchestra.run.smithi094.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-04-26T12:07:26.237 INFO:teuthology.orchestra.run.smithi094.stdout:(124/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 9.7 MB/s | 3.6 MB 00:00 2024-04-26T12:07:26.256 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-04-26T12:07:26.256 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-04-26T12:07:26.271 INFO:teuthology.orchestra.run.smithi094.stdout:(125/136): elfutils-libs-0.189-3.el8.x86_64.rpm 3.2 MB/s | 303 kB 00:00 2024-04-26T12:07:26.380 INFO:teuthology.orchestra.run.smithi094.stdout:(126/136): librados2-18.2.2-1256.gdc093b5e.el8. 6.9 MB/s | 3.7 MB 00:00 2024-04-26T12:07:26.455 INFO:teuthology.orchestra.run.smithi094.stdout:(127/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.2 MB/s | 711 kB 00:00 2024-04-26T12:07:26.505 INFO:teuthology.orchestra.run.smithi094.stdout:(128/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 6.3 MB/s | 1.5 MB 00:00 2024-04-26T12:07:26.547 INFO:teuthology.orchestra.run.smithi094.stdout:(129/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2024-04-26T12:07:26.589 INFO:teuthology.orchestra.run.smithi094.stdout:(130/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 221 kB 00:00 2024-04-26T12:07:26.631 INFO:teuthology.orchestra.run.smithi094.stdout:(131/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.0 MB/s | 254 kB 00:00 2024-04-26T12:07:26.687 INFO:teuthology.orchestra.run.smithi094.stdout:(132/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 237 kB 00:00 2024-04-26T12:07:26.740 INFO:teuthology.orchestra.run.smithi094.stdout:(133/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-04-26T12:07:26.765 INFO:teuthology.orchestra.run.smithi094.stdout:(134/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 739 kB/s | 99 kB 00:00 2024-04-26T12:07:26.866 INFO:teuthology.orchestra.run.smithi094.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 14 MB/s | 2.5 MB 00:00 2024-04-26T12:07:26.891 INFO:teuthology.orchestra.run.smithi094.stdout:(136/136): util-linux-user-2.32.1-44.el8_9.1.x8 684 kB/s | 103 kB 00:00 2024-04-26T12:07:26.894 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:07:26.894 INFO:teuthology.orchestra.run.smithi094.stdout:Total 8.3 MB/s | 206 MB 00:24 2024-04-26T12:07:27.493 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-04-26T12:07:27.506 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-04-26T12:07:27.828 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-04-26T12:07:28.215 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-04-26T12:07:28.215 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-04-26T12:07:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-04-26T12:07:29.099 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:07:29.146 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-26T12:07:29.278 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:07:29.443 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-04-26T12:07:29.453 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-04-26T12:07:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:29.538 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:29.752 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:07:29.911 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:07:30.018 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:30.163 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:30.340 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:30.408 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:30.528 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:07:30.578 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:07:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-26T12:07:30.764 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-26T12:07:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:07:30.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:07:30.997 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:07:31.025 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:07:31.215 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:31.232 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:31.613 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:31.634 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:31.782 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:31.848 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:32.170 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:32.255 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:32.349 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:32.457 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:32.473 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:32.584 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:32.632 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:32.727 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:32.757 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:32.846 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:32.960 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:07:33.035 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:07:33.135 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:07:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:07:33.285 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:07:33.292 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-04-26T12:07:33.402 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:07:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:33.439 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:07:33.520 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:33.557 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:33.631 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:33.664 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:33.708 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:33.790 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:33.813 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:34.133 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:34.256 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:07:34.281 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:34.337 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:07:34.372 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:34.418 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:34.494 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:34.501 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-26T12:07:34.562 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:07:34.643 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:34.721 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:34.743 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-26T12:07:34.815 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-26T12:07:34.921 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-04-26T12:07:34.923 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:07:35.006 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-26T12:07:35.045 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-26T12:07:35.055 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:07:35.095 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-26T12:07:35.189 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:07:35.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-26T12:07:35.251 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:07:35.324 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:07:35.357 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:07:35.382 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:35.397 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:07:35.519 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:07:35.533 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:07:35.559 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:35.598 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:07:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:07:35.775 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:07:35.962 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:35.984 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:36.034 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:07:36.146 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:07:36.209 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:36.221 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:36.288 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:07:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:07:36.326 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:07:36.472 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:07:36.535 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:07:36.644 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:36.721 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-26T12:07:36.788 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-26T12:07:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:36.948 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:07:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/150 2024-04-26T12:07:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:07:37.110 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:37.164 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:07:37.211 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:37.245 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:37.300 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:07:37.441 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:07:37.623 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:07:37.635 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:07:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:07:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:07:37.862 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:37.942 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:37.989 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:07:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:38.120 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-26T12:07:38.184 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:38.235 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:07:38.295 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-26T12:07:38.353 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-26T12:07:38.384 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:38.429 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:38.486 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-26T12:07:38.539 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:07:38.591 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:07:38.687 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:38.729 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:07:38.732 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:07:38.768 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:07:38.783 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:38.866 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:07:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:07:38.956 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:07:39.049 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:07:39.120 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:07:39.143 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:07:39.173 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:07:39.307 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-26T12:07:39.314 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:07:39.366 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:07:39.381 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:07:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:39.572 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:07:39.573 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-26T12:07:39.636 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:07:39.762 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:39.791 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-26T12:07:39.933 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:07:39.963 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:07:40.081 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:07:40.195 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:40.253 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:07:40.278 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:07:40.500 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:07:40.662 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-26T12:07:40.799 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-26T12:07:40.937 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:07:40.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-26T12:07:41.058 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:07:41.100 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:07:41.329 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:07:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-26T12:07:41.604 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-26T12:07:41.707 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-26T12:07:41.758 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:07:41.787 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-26T12:07:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:07:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-26T12:07:42.437 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-26T12:07:42.645 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.15-6.el8.x86_64 22/150 2024-04-26T12:07:42.647 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-26T12:07:42.651 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-26T12:07:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:07:42.940 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-26T12:07:42.993 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-26T12:07:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-26T12:07:43.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:07:43.233 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-26T12:07:43.251 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-26T12:07:43.331 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 22/150 2024-04-26T12:07:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:07:43.461 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:07:43.482 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:07:43.611 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:07:43.635 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/150 2024-04-26T12:07:43.649 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:07:43.665 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:07:43.796 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:07:43.797 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:07:43.808 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/150 2024-04-26T12:07:43.903 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:07:43.980 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:43.998 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 25/150 2024-04-26T12:07:44.043 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:44.071 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:07:44.087 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:07:44.246 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:44.310 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:07:44.311 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:44.313 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/150 2024-04-26T12:07:44.321 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:44.396 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:44.542 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:07:44.599 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/150 2024-04-26T12:07:44.637 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:44.689 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:44.764 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:07:44.854 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:07:44.908 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:07:44.946 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:07:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:07:45.189 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:07:45.312 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:45.408 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:45.465 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:07:45.688 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:45.715 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:45.746 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:45.896 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:07:45.975 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:07:46.113 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:46.140 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : jq-1.6-7.el8.x86_64 48/150 2024-04-26T12:07:46.267 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:07:46.354 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:07:46.419 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:07:46.444 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/150 2024-04-26T12:07:46.462 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.1-8.el8.noarch 49/150 2024-04-26T12:07:46.638 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-26T12:07:46.657 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 50/150 2024-04-26T12:07:46.672 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : jq-1.6-7.el8.x86_64 48/150 2024-04-26T12:07:46.791 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2024-04-26T12:07:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 51/150 2024-04-26T12:07:46.878 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.1-8.el8.noarch 49/150 2024-04-26T12:07:47.021 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 52/150 2024-04-26T12:07:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2024-04-26T12:07:47.075 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 50/150 2024-04-26T12:07:47.196 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-16.8-9.el8.noarch 53/150 2024-04-26T12:07:47.252 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 51/150 2024-04-26T12:07:47.253 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-26T12:07:47.424 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.7-17.el8.x86_64 54/150 2024-04-26T12:07:47.462 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 52/150 2024-04-26T12:07:47.635 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 55/150 2024-04-26T12:07:47.649 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.7-17.el8.x86_64 53/150 2024-04-26T12:07:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-26T12:07:47.816 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 56/150 2024-04-26T12:07:47.884 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 54/150 2024-04-26T12:07:47.965 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 57/150 2024-04-26T12:07:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-26T12:07:48.074 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/150 2024-04-26T12:07:48.202 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 58/150 2024-04-26T12:07:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-26T12:07:48.281 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/150 2024-04-26T12:07:48.482 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/150 2024-04-26T12:07:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 59/150 2024-04-26T12:07:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:07:48.706 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:07:48.765 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 60/150 2024-04-26T12:07:48.807 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 58/150 2024-04-26T12:07:48.965 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:07:48.983 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 61/150 2024-04-26T12:07:48.986 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-26T12:07:49.084 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 59/150 2024-04-26T12:07:49.159 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:07:49.174 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 62/150 2024-04-26T12:07:49.283 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 60/150 2024-04-26T12:07:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/150 2024-04-26T12:07:49.380 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 63/150 2024-04-26T12:07:49.399 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 61/150 2024-04-26T12:07:49.494 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:49.597 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:07:49.689 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/150 2024-04-26T12:07:49.699 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:49.727 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 64/150 2024-04-26T12:07:49.771 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:49.813 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:07:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:07:49.991 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:07:50.031 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 65/150 2024-04-26T12:07:50.044 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 63/150 2024-04-26T12:07:50.211 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:07:50.319 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 66/150 2024-04-26T12:07:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 64/150 2024-04-26T12:07:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:50.528 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 67/150 2024-04-26T12:07:50.660 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:07:50.668 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 65/150 2024-04-26T12:07:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 68/150 2024-04-26T12:07:50.844 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 66/150 2024-04-26T12:07:50.878 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:50.911 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:50.953 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:07:51.005 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 69/150 2024-04-26T12:07:51.069 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/150 2024-04-26T12:07:51.202 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/150 2024-04-26T12:07:51.272 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:07:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/150 2024-04-26T12:07:51.341 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:51.374 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:51.487 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/150 2024-04-26T12:07:51.522 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:07:51.557 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:07:51.565 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/150 2024-04-26T12:07:51.643 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:07:51.722 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 72/150 2024-04-26T12:07:51.755 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:07:51.803 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/150 2024-04-26T12:07:51.915 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 73/150 2024-04-26T12:07:51.958 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-7.el8.x86_64 48/150 2024-04-26T12:07:51.985 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:51.988 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/150 2024-04-26T12:07:52.150 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.1-8.el8.noarch 49/150 2024-04-26T12:07:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 74/150 2024-04-26T12:07:52.217 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 72/150 2024-04-26T12:07:52.293 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:07:52.354 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 50/150 2024-04-26T12:07:52.467 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:07:52.473 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:07:52.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 73/150 2024-04-26T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 51/150 2024-04-26T12:07:52.668 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 52/150 2024-04-26T12:07:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-16.8-9.el8.noarch 74/150 2024-04-26T12:07:52.736 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:07:52.862 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.7-17.el8.x86_64 53/150 2024-04-26T12:07:52.874 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:07:52.894 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:52.911 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:07:52.934 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:07:53.055 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:07:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 54/150 2024-04-26T12:07:53.122 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.7-17.el8.x86_64 47/150 2024-04-26T12:07:53.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:07:53.272 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/150 2024-04-26T12:07:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:07:53.325 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:07:53.339 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/150 2024-04-26T12:07:53.428 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/150 2024-04-26T12:07:53.535 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:07:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 49/150 2024-04-26T12:07:53.568 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:07:53.679 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/150 2024-04-26T12:07:53.766 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:07:53.771 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 50/150 2024-04-26T12:07:53.788 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:07:53.897 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:07:53.955 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 51/150 2024-04-26T12:07:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:07:54.000 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 58/150 2024-04-26T12:07:54.120 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:07:54.155 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:07:54.259 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/150 2024-04-26T12:07:54.307 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:07:54.332 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:07:54.364 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 59/150 2024-04-26T12:07:54.521 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/150 2024-04-26T12:07:54.538 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:07:54.570 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:07:54.579 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 60/150 2024-04-26T12:07:54.730 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:07:54.765 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 54/150 2024-04-26T12:07:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 61/150 2024-04-26T12:07:54.813 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:07:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 55/150 2024-04-26T12:07:54.908 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:07:54.966 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:07:54.984 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/150 2024-04-26T12:07:55.139 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:07:55.153 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 56/150 2024-04-26T12:07:55.212 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:07:55.347 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:07:55.360 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 63/150 2024-04-26T12:07:55.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:07:55.499 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:07:55.523 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 57/150 2024-04-26T12:07:55.623 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 64/150 2024-04-26T12:07:55.674 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:07:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:07:55.846 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 58/150 2024-04-26T12:07:55.882 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:07:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 65/150 2024-04-26T12:07:56.026 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:07:56.117 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 59/150 2024-04-26T12:07:56.141 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 66/150 2024-04-26T12:07:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:07:56.338 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/150 2024-04-26T12:07:56.343 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 60/150 2024-04-26T12:07:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:07:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/150 2024-04-26T12:07:56.633 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/150 2024-04-26T12:07:56.814 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/150 2024-04-26T12:07:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/150 2024-04-26T12:07:56.939 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:07:57.093 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/150 2024-04-26T12:07:57.114 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/150 2024-04-26T12:07:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:07:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/150 2024-04-26T12:07:57.358 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/150 2024-04-26T12:07:57.467 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:07:57.470 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:07:57.497 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 72/150 2024-04-26T12:07:57.546 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 65/150 2024-04-26T12:07:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:07:57.776 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/150 2024-04-26T12:07:57.777 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:07:57.795 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 73/150 2024-04-26T12:07:57.958 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:07:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-16.8-9.el8.noarch 74/150 2024-04-26T12:07:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 67/150 2024-04-26T12:07:58.052 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:07:58.141 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:07:58.222 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-16.8-9.el8.noarch 68/150 2024-04-26T12:07:58.234 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:07:58.276 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:07:58.381 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:07:58.452 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 69/150 2024-04-26T12:07:58.531 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 69/150 2024-04-26T12:07:58.560 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:07:58.637 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:07:58.784 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:07:58.822 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:07:58.858 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jq-1.6-7.el8.x86_64 70/150 2024-04-26T12:07:59.008 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:07:59.028 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:07:59.118 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : automake-1.16.1-8.el8.noarch 71/150 2024-04-26T12:07:59.143 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:07:59.177 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:07:59.214 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:07:59.316 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 72/150 2024-04-26T12:07:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:07:59.401 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:07:59.509 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 73/150 2024-04-26T12:07:59.571 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:07:59.646 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:07:59.670 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 74/150 2024-04-26T12:07:59.734 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:07:59.854 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:07:59.860 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:08:00.009 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:08:00.034 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:08:00.072 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:08:00.196 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:08:00.363 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:08:00.432 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:08:00.518 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:08:00.591 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:08:00.669 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:08:00.829 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:08:00.831 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:08:01.029 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:08:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:08:01.260 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:08:01.357 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:08:01.505 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:08:01.548 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:08:01.703 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:08:01.751 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:08:01.888 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:08:02.024 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:08:02.253 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:08:02.479 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:08:02.673 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:08:02.945 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:08:02.957 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:08:03.225 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:08:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:03.292 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:08:03.416 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:08:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:08:03.534 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:03.648 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:08:03.820 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:08:04.091 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:08:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:04.285 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:08:04.314 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:04.406 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:04.567 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:04.708 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:08:05.105 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:08:05.143 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:08:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:05.322 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:08:05.471 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:08:05.544 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:08:05.660 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:08:05.730 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:08:05.845 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:06.051 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:08:06.284 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:08:06.376 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:07.099 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:08:07.283 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:08:07.340 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:08:07.550 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:08:09.834 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:10.097 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:11.271 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:11.353 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:11.450 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:11.596 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:12.076 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:12.670 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:08:12.961 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:13.064 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:08:13.200 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:23.990 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-04-26T12:08:23.990 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /dev 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /run 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /dev 2024-04-26T12:08:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:08:24.363 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:26.000 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:26.158 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:26.158 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /run 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2024-04-26T12:08:26.159 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:08:26.268 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:26.487 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:26.554 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:26.646 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:27.120 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:28.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:28.681 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:29.145 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:29.293 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:08:29.332 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:29.486 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:29.504 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:29.536 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:08:29.794 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:30.823 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:31.025 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:31.322 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:31.642 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:08:31.857 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:08:31.991 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:32.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:32.262 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:32.506 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /dev 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /run 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /dev 2024-04-26T12:08:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:08:32.638 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:08:32.792 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:32.889 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:32.969 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:32.980 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:33.137 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:33.347 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /run 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2024-04-26T12:08:33.907 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:08:34.253 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:08:34.319 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:34.326 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:34.441 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:34.469 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:34.476 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:34.526 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:34.561 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:34.627 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:34.791 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:34.920 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:08:34.974 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:35.010 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:35.106 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:35.144 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:35.144 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:35.180 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:35.326 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:35.338 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:35.656 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:35.814 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:35.832 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:36.137 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:08:36.382 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:36.607 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:08:36.627 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:08:36.793 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:36.813 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:36.848 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:36.993 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:37.319 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:08:37.343 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:37.450 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:37.472 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:08:37.484 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:37.624 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:37.819 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:37.937 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:08:38.179 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:08:38.405 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:39.590 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:39.591 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:39.699 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:39.735 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:08:39.891 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:08:40.119 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:08:40.333 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:40.470 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:08:40.661 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:40.713 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-26T12:08:40.821 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:40.916 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:40.966 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-26T12:08:41.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:41.303 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:08:41.397 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:08:41.409 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:08:41.470 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:08:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:41.538 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:41.611 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:08:41.696 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:41.706 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:41.708 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:41.779 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:08:41.973 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:08:41.975 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:42.190 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:08:42.401 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:08:42.679 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:08:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:08:42.905 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:08:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:42.961 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:08:42.969 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:08:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:43.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:08:43.191 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-26T12:08:43.252 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:08:43.371 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:43.451 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:08:43.458 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:08:43.471 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:08:43.483 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-26T12:08:43.643 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:43.660 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-26T12:08:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:43.688 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:08:43.718 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:43.811 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:08:43.871 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:43.882 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:43.898 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:08:43.928 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:08:43.943 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:08:43.995 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:08:43.996 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:44.169 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:08:44.294 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:44.294 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:44.329 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:08:44.512 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:44.512 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:44.556 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:08:44.735 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:44.745 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:08:44.902 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:44.966 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:08:45.126 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:08:45.127 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:45.231 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:08:45.274 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:08:45.369 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:45.369 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:45.465 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:45.506 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:08:45.561 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:45.568 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:45.569 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:45.674 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:45.782 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:08:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:45.860 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:08:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:46.060 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:08:46.099 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:08:46.112 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:08:46.224 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:46.269 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:46.269 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:46.293 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-26T12:08:46.440 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:08:46.533 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:46.661 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:08:46.661 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:46.691 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:46.951 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:46.952 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:47.161 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:47.161 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:08:47.317 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:08:47.318 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:08:47.319 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:08:47.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:08:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:08:47.333 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 71/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 72/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 73/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 76/150 2024-04-26T12:08:47.334 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 77/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 79/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 80/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 81/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 82/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 83/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 84/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 85/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 86/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 87/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 88/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 90/150 2024-04-26T12:08:47.335 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 91/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 92/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 93/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 94/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 95/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 96/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 97/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 98/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.0.4-10.el8.x86_64 103/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.1-9.el8.x86_64 104/150 2024-04-26T12:08:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 106/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 107/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 110/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 111/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 112/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 114/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 115/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 116/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 117/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.1-8.el8.noarch 118/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : jq-1.6-7.el8.x86_64 119/150 2024-04-26T12:08:47.337 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 120/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 121/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 122/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:08:47.338 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:08:47.341 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:47.342 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:08:47.426 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:47.584 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:08:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:48.093 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:48.093 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:48.317 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:48.593 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:48.593 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:48.614 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:08:48.819 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/150 2024-04-26T12:08:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:49.101 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:49.102 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:49.501 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/150 2024-04-26T12:08:49.607 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:49.817 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/150 2024-04-26T12:08:50.078 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 125/150 2024-04-26T12:08:50.200 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:08:50.201 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:08:50.202 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:08:50.203 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:08:50.204 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 70/150 2024-04-26T12:08:50.205 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 71/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 73/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 74/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 76/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 78/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 79/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 80/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 81/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 82/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 83/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 84/150 2024-04-26T12:08:50.206 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 85/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 86/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 87/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 88/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 91/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 92/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 93/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 94/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 95/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 96/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 97/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 98/150 2024-04-26T12:08:50.207 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.0.4-10.el8.x86_64 103/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.1-9.el8.x86_64 104/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 106/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 107/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 110/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 111/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 112/150 2024-04-26T12:08:50.208 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 114/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 115/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 116/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 117/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.1-8.el8.noarch 118/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : jq-1.6-7.el8.x86_64 119/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 120/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 121/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 122/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:08:50.209 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:08:50.210 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:50.211 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:08:50.285 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/150 2024-04-26T12:08:50.506 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:08:50.683 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:08:50.927 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:08:51.150 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:08:51.198 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:08:51.438 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:08:51.750 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:08:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:52.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:08:52.283 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 134/150 2024-04-26T12:08:52.446 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-26T12:08:52.495 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.1-9.el8.x86_64 135/150 2024-04-26T12:08:52.575 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 135/150 2024-04-26T12:08:52.748 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-26T12:08:52.804 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.0.4-10.el8.x86_64 136/150 2024-04-26T12:08:52.817 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 136/150 2024-04-26T12:08:52.976 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:53.001 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:08:53.205 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:08:53.215 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:08:53.215 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:53.223 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:08:53.420 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:08:53.489 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:53.489 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:53.578 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:08:53.715 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:53.715 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:53.890 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:08:53.981 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:54.064 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:08:54.146 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:54.250 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:08:54.380 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:08:54.380 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:54.552 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:08:54.639 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:54.639 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:54.839 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:55.022 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:08:55.109 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:08:55.164 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:55.164 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:55.289 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:08:55.306 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:08:55.397 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:55.397 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:55.458 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-26T12:08:55.635 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:08:55.664 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:55.665 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:55.811 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:08:55.811 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:55.934 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:08:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:56.111 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:56.318 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:08:56.319 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:56.575 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:08:56.739 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:08:56.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:08:56.741 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:08:56.741 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:08:56.741 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:08:56.741 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:08:56.757 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:08:56.760 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:08:56.761 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:08:56.762 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:08:56.762 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:08:56.762 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:08:56.762 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:08:56.762 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:08:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:08:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:08:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:08:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:08:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:08:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:08:56.764 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:08:56.764 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:08:56.764 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:08:56.764 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:08:56.764 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:08:56.764 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 70/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 71/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 72/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 73/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 74/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/150 2024-04-26T12:08:56.765 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.1-9.el8.x86_64 77/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 78/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 80/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 82/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 83/150 2024-04-26T12:08:56.766 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 84/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 85/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 86/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 87/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 88/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 89/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 90/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : automake-1.16.1-8.el8.noarch 91/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jq-1.6-7.el8.x86_64 92/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 93/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 94/150 2024-04-26T12:08:56.767 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 95/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 96/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 97/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 100/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 101/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 102/150 2024-04-26T12:08:56.768 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 103/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 104/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 105/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 108/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 109/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 110/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 111/150 2024-04-26T12:08:56.769 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 112/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 113/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 114/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 115/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 116/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 117/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 118/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 119/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 120/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 121/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 122/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:08:56.770 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:08:56.771 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:56.772 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:08:56.974 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:08:56.975 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:57.192 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:57.192 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:57.433 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:08:57.433 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:57.625 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:57.625 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:08:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:58.101 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:58.101 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:58.356 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:08:58.532 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:08:59.209 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:08:59.210 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:08:59.210 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:08:59.210 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:08:59.210 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:08:59.210 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:08:59.210 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:08:59.224 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:08:59.225 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:08:59.226 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:08:59.227 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 70/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 71/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 73/150 2024-04-26T12:08:59.228 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 74/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 76/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 78/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 79/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 80/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 81/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 82/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 83/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 84/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 85/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 86/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 87/150 2024-04-26T12:08:59.229 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 88/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 91/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 92/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 93/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 94/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 95/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 96/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 97/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 98/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/150 2024-04-26T12:08:59.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.0.4-10.el8.x86_64 103/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.1-9.el8.x86_64 104/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 106/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 107/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 110/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 111/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 112/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 114/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 115/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 116/150 2024-04-26T12:08:59.231 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 117/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.1-8.el8.noarch 118/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-7.el8.x86_64 119/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 120/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 121/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 122/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:08:59.232 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:08:59.233 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:08:59.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:08:59.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:08:59.234 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:09:00.029 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:09:00.030 INFO:teuthology.orchestra.run.smithi104.stdout:Installed products updated. 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.309 INFO:teuthology.orchestra.run.smithi104.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.310 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.311 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:09:01.312 INFO:teuthology.orchestra.run.smithi104.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.313 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:09:01.314 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:09:01.315 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:09:01.316 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.317 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:09:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:09:01.319 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:01.320 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-26T12:09:02.066 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:03.639 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:09:03.639 INFO:teuthology.orchestra.run.smithi071.stdout:Installed products updated. 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.436 INFO:teuthology.orchestra.run.smithi071.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.437 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.438 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:09:04.439 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:09:04.441 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:09:04.442 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:09:04.443 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:09:04.444 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:09:04.445 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:09:04.446 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:09:04.447 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:09:04.447 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:04.447 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-04-26T12:09:04.631 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:10.227 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:09:10.227 INFO:teuthology.orchestra.run.smithi094.stdout:Installed products updated. 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:09:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:09:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:09:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:09:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:09:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:09:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:09:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:09:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:09:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:09:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:09:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:10.847 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-04-26T12:09:11.049 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:13.696 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:09:13.697 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:09:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:09:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:09:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:09:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:09:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:09:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:09:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:09:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:09:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:09:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:14.417 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-04-26T12:09:14.660 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:14.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:09:14.881 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:09:14.910 INFO:teuthology.orchestra.run.smithi045.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:14.911 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:14.911 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:09:14.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:09:15.048 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:09:15.077 INFO:teuthology.orchestra.run.smithi071.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:15.077 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:15.077 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:09:15.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:09:15.215 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:09:15.244 INFO:teuthology.orchestra.run.smithi094.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:15.245 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:15.245 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:09:15.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:09:15.459 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:09:15.489 INFO:teuthology.orchestra.run.smithi104.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:15.489 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:09:15.490 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:09:15.491 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:09:15.491 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:15.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:09:15.546 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:15.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:09:15.594 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:15.595 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:09:15.646 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:15.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:09:15.695 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:09:15.696 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:15.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:09:15.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:09:15.807 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:15.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:09:15.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:09:15.911 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:15.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:09:15.944 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:09:16.016 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:16.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:09:16.049 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:09:16.119 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:09:16.119 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:16.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:09:16.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:09:16.229 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:16.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:09:16.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:09:16.334 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:16.334 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:09:16.367 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:09:16.438 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:16.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:09:16.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:09:16.542 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:09:16.542 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:16.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:09:16.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:09:16.701 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:16.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:09:16.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:09:16.803 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:16.803 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:09:16.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:09:16.912 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:16.912 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:09:16.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:09:17.014 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:09:17.109 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:09:17.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2024-04-26T12:09:17.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-04-26T12:09:17.114 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-04-26T12:09:17.117 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-04-26T12:09:17.148 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:09:17.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:09:17.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:09:17.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:09:17.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:09:17.222 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:09:17.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:09:17.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:09:17.265 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:09:17.268 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:09:17.308 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:09:17.308 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:09:17.308 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674196', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuht1w7cqb4eeAMu/L+Cb1nidg3BNtRY8JVnHh95gsdhJurFBpfGEsACSmiDKf4rk+2UXTMJkbqVTaI1/uG5HQ=', 'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKY30irRSJSm116C6XqG/lMuwEV1m7kY5CHXZxQf3Kbms4rKRyVS5M+EoGN4UJTK3HDLcnBhZ/lOJ29fpaFtsDI=', 'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa62qQ2QZ34/56ePRTRcYyUoi1CXk+tAfuCKi1FXlgPvkEyRTj/8t62PSkeIsRunjvPkgbZhFsNZ4IG7r7HVXo=', 'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH84y4T70o3zzH1UUOYsBYNbO9NLMLdpqr6qLMoQtPMQrOaRkb61w+4LdgKehx3lBe3t8hTDxWHyiN9hgrUUM+U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:09:17.309 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:09:17.339 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:09:17.341 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:09:17.343 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:09:17.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:09:17.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:09:17.404 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:09:17.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:09:17.434 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:17.435 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:09:17.487 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:09:17.487 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 180685 Links: 1 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 12:08:49.840889827 +0000 2024-04-26T12:09:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 12:04:27.582510721 +0000 2024-04-26T12:09:17.545 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 12:04:27.582510721 +0000 2024-04-26T12:09:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-26T12:09:17.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:09:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T12:09:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T12:09:17.610 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00032337 s, 1.6 MB/s 2024-04-26T12:09:17.611 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:09:17.670 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-04-26T12:09:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 179806 Links: 1 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 12:08:49.840889827 +0000 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 12:04:27.953504087 +0000 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 12:04:27.953504087 +0000 2024-04-26T12:09:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-26T12:09:17.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:09:17.793 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T12:09:17.793 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T12:09:17.793 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000217475 s, 2.4 MB/s 2024-04-26T12:09:17.794 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:09:17.851 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 176918 Links: 1 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 12:08:49.840889827 +0000 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 12:04:28.319497543 +0000 2024-04-26T12:09:17.909 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 12:04:28.319497543 +0000 2024-04-26T12:09:17.910 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-26T12:09:17.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:09:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T12:09:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T12:09:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000191468 s, 2.7 MB/s 2024-04-26T12:09:17.976 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:09:18.034 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-04-26T12:09:18.092 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:09:18.092 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:18.092 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 180845 Links: 1 2024-04-26T12:09:18.093 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:18.093 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:18.093 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-26 12:08:49.840889827 +0000 2024-04-26T12:09:18.093 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-26 12:04:28.657491500 +0000 2024-04-26T12:09:18.093 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-26 12:04:28.657491500 +0000 2024-04-26T12:09:18.093 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-26T12:09:18.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:09:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-26T12:09:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-26T12:09:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000219079 s, 2.3 MB/s 2024-04-26T12:09:18.159 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:09:18.217 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:09:18.218 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:18.218 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:09:18.239 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:09:18.239 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 181485 Links: 1 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-26 12:08:56.390460813 +0000 2024-04-26T12:09:18.300 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-26 12:04:41.425153769 +0000 2024-04-26T12:09:18.301 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-26 12:04:41.425153769 +0000 2024-04-26T12:09:18.301 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-26T12:09:18.301 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:09:18.370 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-26T12:09:18.370 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-26T12:09:18.370 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000100054 s, 5.1 MB/s 2024-04-26T12:09:18.371 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:09:18.431 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 179086 Links: 1 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-26 12:08:56.390460813 +0000 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-26 12:04:41.781148000 +0000 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-26 12:04:41.781148000 +0000 2024-04-26T12:09:18.490 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-26T12:09:18.491 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:09:18.557 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-26T12:09:18.558 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-26T12:09:18.558 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000136283 s, 3.8 MB/s 2024-04-26T12:09:18.559 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:09:18.618 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-04-26T12:09:18.677 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:09:18.677 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:18.677 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 179153 Links: 1 2024-04-26T12:09:18.678 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:18.678 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:18.678 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-26 12:08:56.390460813 +0000 2024-04-26T12:09:18.678 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-26 12:04:42.145142102 +0000 2024-04-26T12:09:18.678 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-26 12:04:42.145142102 +0000 2024-04-26T12:09:18.678 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-26T12:09:18.678 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:09:18.743 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-26T12:09:18.743 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-26T12:09:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000112011 s, 4.6 MB/s 2024-04-26T12:09:18.745 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:09:18.803 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-04-26T12:09:18.861 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:09:18.862 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:18.862 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 185365 Links: 1 2024-04-26T12:09:18.862 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:18.862 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:18.862 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-04-26 12:08:56.390460813 +0000 2024-04-26T12:09:18.862 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-04-26 12:04:42.486136577 +0000 2024-04-26T12:09:18.863 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-04-26 12:04:42.486136577 +0000 2024-04-26T12:09:18.863 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-04-26T12:09:18.863 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:09:18.928 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-04-26T12:09:18.928 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-04-26T12:09:18.928 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000123619 s, 4.1 MB/s 2024-04-26T12:09:18.929 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:09:18.987 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:09:18.987 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:18.988 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:09:19.009 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:09:19.009 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 181799 Links: 1 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-26 12:08:46.960188785 +0000 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-26 12:04:55.226758033 +0000 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-26 12:04:55.226758033 +0000 2024-04-26T12:09:19.070 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-26T12:09:19.071 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:09:19.140 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-26T12:09:19.140 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-26T12:09:19.140 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000222074 s, 2.3 MB/s 2024-04-26T12:09:19.141 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:09:19.201 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-04-26T12:09:19.260 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:09:19.260 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:19.260 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 184632 Links: 1 2024-04-26T12:09:19.260 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:19.261 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:19.261 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-26 12:08:46.960188785 +0000 2024-04-26T12:09:19.261 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-26 12:04:55.574754005 +0000 2024-04-26T12:09:19.261 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-26 12:04:55.574754005 +0000 2024-04-26T12:09:19.261 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-26T12:09:19.261 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:09:19.328 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-26T12:09:19.328 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-26T12:09:19.328 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000231203 s, 2.2 MB/s 2024-04-26T12:09:19.329 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:09:19.389 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-04-26T12:09:19.447 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:09:19.447 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:19.447 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 178918 Links: 1 2024-04-26T12:09:19.448 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:19.448 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:19.448 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-26 12:08:46.960188785 +0000 2024-04-26T12:09:19.448 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-26 12:04:55.940749770 +0000 2024-04-26T12:09:19.448 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-26 12:04:55.940749770 +0000 2024-04-26T12:09:19.448 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-26T12:09:19.448 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:09:19.513 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-26T12:09:19.513 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-26T12:09:19.513 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000191504 s, 2.7 MB/s 2024-04-26T12:09:19.514 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:09:19.573 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-04-26T12:09:19.630 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:09:19.630 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 179859 Links: 1 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-26 12:08:46.960188785 +0000 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-26 12:04:56.295745661 +0000 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-26 12:04:56.295745661 +0000 2024-04-26T12:09:19.631 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-26T12:09:19.631 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:09:19.698 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-26T12:09:19.698 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-26T12:09:19.699 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000242858 s, 2.1 MB/s 2024-04-26T12:09:19.699 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:09:19.757 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:09:19.757 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:09:19.757 INFO:tasks.ceph:Generating config... 2024-04-26T12:09:19.758 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:09:19.759 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:09:19.759 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:09:19.759 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:09:19.759 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:09:19.759 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:09:19.759 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T12:09:19.760 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:09:19.760 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:09:19.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:09:19.820 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:09:19.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:09:19.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:09:19.909 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '[v2:172.21.15.45:3301,v1:172.21.15.45:6790]'), ('mon.c', '[v2:172.21.15.45:3302,v1:172.21.15.45:6791]')] 2024-04-26T12:09:19.910 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790],[v2:172.21.15.45:3302,v1:172.21.15.45:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-26T12:09:19.912 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:19.912 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:09:19.972 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --addv b '[v2:172.21.15.45:3301,v1:172.21.15.45:6790]' --addv c '[v2:172.21.15.45:3302,v1:172.21.15.45:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:20.071 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:20.071 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:09:20.071 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2024-04-26T12:09:20.071079+0000 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-04-26T12:09:20.071079+0000 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] mon.b 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.45:3302/0,v1:172.21.15.45:6791/0] mon.c 2024-04-26T12:09:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T12:09:20.074 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:09:20.093 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 238e0384-60e0-4b21-9d3a-782265888521... 2024-04-26T12:09:20.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:09:20.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:09:20.138 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:09:20.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:09:20.188 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-04-26T12:09:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-04-26T12:09:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:09:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-04-26T12:09:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:09:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-04-26T12:09:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790],[v2:172.21.15.45:3302,v1:172.21.15.45:6791]" 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-04-26T12:09:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-04-26T12:09:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:09:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: osd max markdown count = 1000 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:09:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-04-26T12:09:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-04-26T12:09:20.198 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-04-26T12:09:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:09:20.199 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-04-26T12:09:20.200 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:09:20.201 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-04-26T12:09:20.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790],[v2:172.21.15.45:3302,v1:172.21.15.45:6791]" 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-04-26T12:09:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-04-26T12:09:20.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:09:20.205 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: osd max markdown count = 1000 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.206 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.207 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-04-26T12:09:20.208 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:09:20.209 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-04-26T12:09:20.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:09:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790],[v2:172.21.15.45:3302,v1:172.21.15.45:6791]" 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.212 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-04-26T12:09:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:09:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: osd max markdown count = 1000 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-26T12:09:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:09:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-04-26T12:09:20.218 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2024-04-26T12:09:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790],[v2:172.21.15.45:3302,v1:172.21.15.45:6791]" 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2024-04-26T12:09:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2024-04-26T12:09:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-04-26T12:09:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: osd max markdown count = 1000 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2024-04-26T12:09:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2024-04-26T12:09:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2024-04-26T12:09:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-04-26T12:09:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T12:09:20.231 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:09:20.231 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:09:20.341 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:09:20.341 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:20.342 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:09:20.361 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:20.361 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:09:20.422 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2024-04-26T12:09:20.422 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:20.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:09:20.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:09:20.509 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:20.509 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:20.571 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:09:20.571 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:20.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:09:20.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:09:20.616 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:20.616 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:20.675 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-04-26T12:09:20.676 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:20.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:09:20.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:09:20.721 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:20.721 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:20.780 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-04-26T12:09:20.780 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:20.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:09:20.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:09:20.822 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:20.822 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:20.880 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:09:20.880 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:09:20.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:09:20.947 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:09:20.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:09:21.014 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:09:21.017 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:09:21.017 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:09:21.081 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:09:21.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T12:09:21.116 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:09:21.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:09:21.210 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:09:21.226 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:09:21.226 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:09:21.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:09:21.258 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:09:21.258 INFO:tasks.ceph:role: osd.0 2024-04-26T12:09:21.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:09:21.258 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:09:21.337 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:09:21.768 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-26T12:09:21.769 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-26T12:09:21.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:09:21.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:09:21.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:22.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T12:09:22.149+0000 7f8a21cc37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:09:22.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T12:09:22.152+0000 7f8a21cc37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:09:22.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T12:09:22.152+0000 7f8a21cc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:09:22.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T12:09:22.152+0000 7f8a21cc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:09:22.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T12:09:22.152+0000 7f8a21cc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:09:22.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-26T12:09:22.155+0000 7f8a21cc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:09:25.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:09:25.043 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:09:25.076 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:09:25.077 INFO:tasks.ceph:role: osd.1 2024-04-26T12:09:25.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-26T12:09:25.077 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:09:25.149 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:09:25.149 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:09:25.149 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:09:25.149 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:09:25.149 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:09:25.149 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:09:25.150 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:09:25.150 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:09:25.150 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:09:25.150 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:09:25.172 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-04-26T12:09:25.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-04-26T12:09:25.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:09:25.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:09:25.300 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:25.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-26T12:09:25.404+0000 7f4c3402b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:09:25.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-26T12:09:25.404+0000 7f4c3402b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:09:25.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-26T12:09:25.404+0000 7f4c3402b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:09:25.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-26T12:09:25.404+0000 7f4c3402b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:09:25.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-26T12:09:25.404+0000 7f4c3402b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:09:25.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-04-26T12:09:25.404+0000 7f4c3402b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:09:28.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:09:28.291 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:09:28.325 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:09:28.325 INFO:tasks.ceph:role: osd.2 2024-04-26T12:09:28.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-26T12:09:28.325 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:09:28.403 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:09:28.404 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:09:28.840 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-26T12:09:28.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-26T12:09:28.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T12:09:29.025 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:09:29.063 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:29.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-26T12:09:29.193+0000 7fc5c81b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:09:29.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-26T12:09:29.196+0000 7fc5c81b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:09:29.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-26T12:09:29.196+0000 7fc5c81b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:09:29.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-26T12:09:29.196+0000 7fc5c81b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:09:29.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-26T12:09:29.196+0000 7fc5c81b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:09:29.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-26T12:09:29.203+0000 7fc5c81b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:09:32.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:09:32.090 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:09:32.090 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:32.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:09:32.125 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:32.125 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T12:09:32.202 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:32.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T12:09:32.277 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:32.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:09:32.310 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:32.310 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:09:32.344 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:32.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:09:32.377 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-04-26T12:09:32.377 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:09:32.398 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:09:32.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:09:32.472 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2024-04-26T12:09:32.472 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBwmStmSrp3OBAA6dYm9uUpbAIvtbDW0DOIGw== 2024-04-26T12:09:32.472 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2024-04-26T12:09:32.472 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBxmStmHereABAAyXv+kEi53MgpJ4DzbJsQBw== 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBxmStm5j7bBBAA7FjNmG/2kvjtyxFqUN1gFQ== 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBymStmM2j0CBAAWMJvT4Ki+2Z4KT0zrQVISg== 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQB1mStmnQ4yGBAAFrCMY3MXD1ET/kBveRivyA== 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQB5mStmHsWYCxAAIjVVwwW5biAfEOa+jkZs2Q== 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-04-26T12:09:32.473 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBxmStmpr6JDBAArDU5SOJjmF2Mhzmu3nZJ8w== 2024-04-26T12:09:32.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:09:32.580 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:09:32.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T12:09:32.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:09:32.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:09:32.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:09:32.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:09:32.949 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:09:32.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:09:32.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:09:33.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:09:33.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T12:09:33.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:09:33.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T12:09:33.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T12:09:33.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:09:33.532 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T12:09:33.564 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:09:33.626 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:09:33.626 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:09:33.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:09:33.669 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:09:33.669 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T12:09:33.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T12:09:33.671 INFO:tasks.ceph.mon.b:Started 2024-04-26T12:09:33.671 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T12:09:33.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T12:09:33.673 INFO:tasks.ceph.mon.c:Started 2024-04-26T12:09:33.674 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:09:33.674 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:09:33.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:09:33.677 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:09:33.677 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T12:09:33.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T12:09:33.679 INFO:tasks.ceph.mgr.y:Started 2024-04-26T12:09:33.679 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:09:33.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:09:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2024-04-26T12:09:34.160 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:09:34.160 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:09:34.160 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-26T12:09:34.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:09:34.193 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-04-26T12:09:34.193 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:09:34.225 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-26T12:09:34.225 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:09:34.257 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new f5e89d15-234b-43fa-a34c-aa6987125af4 0 2024-04-26T12:09:34.522 INFO:teuthology.orchestra.run.smithi104.stdout:0 2024-04-26T12:09:34.523 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:34.522+0000 7ffa0b214200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:09:34.534 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new cacdbf9c-7e2f-46fa-9e34-804a2afdb53a 1 2024-04-26T12:09:34.615 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:34.613+0000 7ffa0b214200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:09:34.700 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:34.698+0000 7ffa0b214200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:09:34.747 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-04-26T12:09:34.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 406b2884-83cb-4c28-885d-e6f9a3d25330 2 2024-04-26T12:09:34.782 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:34.781+0000 7ffa0b214200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:09:34.805 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:34.804+0000 7f2615601200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:09:34.896 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:34.894+0000 7f2615601200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:09:34.972 INFO:teuthology.orchestra.run.smithi104.stdout:2 2024-04-26T12:09:34.980 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:34.978+0000 7f2615601200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:09:34.984 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:09:34.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:09:34.985 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:34.982+0000 7ffa0b214200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:09:34.987 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:09:34.987 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:09:34.987 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:09:34.989 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:09:34.990 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:09:34.990 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:09:34.992 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:09:34.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:35.061 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:35.060+0000 7f2615601200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:09:35.185 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:35.184+0000 7ffa0b214200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:09:35.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:35.220 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:34.969233+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:35.236 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:09:35.236 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:09:35.268 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:35.267+0000 7f2615601200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:09:35.315 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:35.314+0000 7ffa0b214200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:09:35.423 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:35.422+0000 7ffa0b214200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:09:35.446 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:35.444+0000 7f2615601200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:09:35.513 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:35.511+0000 7ffa0b214200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:09:35.538 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:35.574 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:35.573+0000 7f2615601200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:09:35.581 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:09:35.580+0000 7f9f9d5527c0 -1 Falling back to public interface 2024-04-26T12:09:35.587 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:09:35.587+0000 7fc0e68f27c0 -1 Falling back to public interface 2024-04-26T12:09:35.591 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:09:35.590+0000 7f9fa78e37c0 -1 Falling back to public interface 2024-04-26T12:09:35.675 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:35.673+0000 7f2615601200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:09:35.780 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:35.778+0000 7ffa0b214200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:09:35.804 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:35.803+0000 7f2615601200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:09:35.811 INFO:teuthology.misc.health.smithi045.stdout: 2024-04-26T12:09:35.811 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":5,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:34.969233+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:35.825 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T12:09:35.863 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:35.861+0000 7ffa0b214200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:09:36.054 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:36.053+0000 7f2615601200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:09:36.135 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:36.134+0000 7f2615601200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:09:36.345 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:36.344+0000 7ffa0b214200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:09:36.503 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:36.502+0000 7f2615601200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:09:36.717 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:36.715+0000 7ffa0b214200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:09:36.872 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:36.871+0000 7f2615601200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:09:36.903 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:36.902+0000 7ffa0b214200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:09:36.994 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:36.993+0000 7ffa0b214200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:09:37.053 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:37.051+0000 7f2615601200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:09:37.136 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:37.134+0000 7f2615601200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:09:37.805 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:37.804+0000 7ffa0b214200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:09:37.850 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:37.848+0000 7f2615601200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:09:37.901 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:37.899+0000 7ffa0b214200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:09:37.938 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:37.937+0000 7f2615601200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:09:38.054 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:38.053+0000 7ffa0b214200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:09:38.082 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:38.080+0000 7f2615601200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:09:38.703 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:38.701+0000 7ffa0b214200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:09:38.703 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:38.702+0000 7f2615601200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:09:38.892 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:38.890+0000 7f2615601200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:09:38.892 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:38.891+0000 7ffa0b214200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:09:39.025 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:09:39.024+0000 7f9f9d5527c0 -1 osd.2 0 log_to_monitors true 2024-04-26T12:09:39.032 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:09:39.031+0000 7fc0e68f27c0 -1 osd.0 0 log_to_monitors true 2024-04-26T12:09:39.036 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:09:39.035+0000 7f9fa78e37c0 -1 osd.1 0 log_to_monitors true 2024-04-26T12:09:39.086 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:39.085+0000 7ffa0b214200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:09:39.087 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:39.086+0000 7f2615601200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:09:40.043 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:40.041+0000 7ffa0b214200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:09:40.043 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:40.042+0000 7f2615601200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:09:40.317 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:40.315+0000 7ffa0b214200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:09:40.317 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:40.316+0000 7f2615601200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:09:40.403 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:40.401+0000 7f2615601200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:09:40.406 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:40.402+0000 7ffa0b214200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:09:40.809 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:09:40.808+0000 7f9f9b498700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:09:40.823 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:09:40.822+0000 7f9f93873700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:09:40.849 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-04-26T12:09:40.848+0000 7ffa0b214200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:09:40.849 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:40.848+0000 7f2615601200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:09:40.937 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:09:40.936+0000 7f9f91107700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:09:40.951 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:09:40.950+0000 7f9f894e2700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:09:40.992 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:09:40.990+0000 7fc0da4a7700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:09:41.002 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:09:41.000+0000 7fc0d2882700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:09:41.868 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:41.866+0000 7f25d09b4700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T12:09:41.868 INFO:tasks.ceph.mgr.x.smithi045.stderr:2024-04-26T12:09:41.866+0000 7f25d09b4700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T12:09:42.127 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:42.488 INFO:teuthology.misc.health.smithi045.stdout: 2024-04-26T12:09:42.488 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":8,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:41.810744+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:42.502 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T12:09:42.503 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:09:42.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:09:42.907 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2024-04-26T12:09:42.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:09:43.910 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:09:43.924 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:09:43.925 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T12:09:43.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T12:09:43.927 INFO:tasks.ceph.mds.a:Started 2024-04-26T12:09:43.927 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T12:09:43.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:44.018 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2024-04-26T12:09:44.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:44.306 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:43.900793+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:44.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:09:44.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:09:44.684 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2024-04-26T12:09:44.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-04-26T12:09:45.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:09:45.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:45.514 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T12:09:45.517 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 2 2024-04-26T12:09:45.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:45.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":12,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:45.903147+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:45.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:09:45.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:09:46.298 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2024-04-26T12:09:46.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:09:46.679 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-04-26T12:09:46.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:09:47.067 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-04-26T12:09:47.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T12:09:47.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T12:09:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2024-04-26T12:09:47.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T12:09:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2024-04-26T12:09:48.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T12:09:49.369 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T12:09:49.382 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:49.748 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:49.748 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:49.359804+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:49.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:50.131 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:50.131 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:49.359804+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:50.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T12:09:51.390 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T12:09:51.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T12:09:52.393 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T12:09:52.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:09:52.814 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:52.814 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:09:49.360137+0000","modified":"2024-04-26T12:09:52.370114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:09:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-04-26T12:09:52.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:53.195 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:50.361573+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:53.210 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T12:09:53.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:53.581 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:53.583 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:09:53.594 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:09:52.857766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.939980"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369165+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:50.369165+0000","last_peered":"2024-04-26T12:09:50.369165+0000","last_clean":"2024-04-26T12:09:50.369165+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:50.369165+0000","last_undegraded":"2024-04-26T12:09:50.369165+0000","last_fullsized":"2024-04-26T12:09:50.369165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:53.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:54.005 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:09:54.019 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:09:52.857766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.939980"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369165+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:50.369165+0000","last_peered":"2024-04-26T12:09:50.369165+0000","last_clean":"2024-04-26T12:09:50.369165+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:50.369165+0000","last_undegraded":"2024-04-26T12:09:50.369165+0000","last_fullsized":"2024-04-26T12:09:50.369165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:54.023 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T12:09:54.023 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:09:54.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:09:54.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:09:54.024 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:09:54.040 INFO:tasks.ceph.mds.a.smithi045.stderr:2024-04-26T12:09:54.038+0000 7fcdf8e93700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:09:54.476 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:54.490 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":39858},{"type":"v1","addr":"172.21.15.45:6801","nonce":39858}]},"active_addr":"172.21.15.45:6801/39858","active_change":"2024-04-26T12:09:40.850822+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":4138611719}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3236388737}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1862739688}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":303081009}]}]} 2024-04-26T12:09:54.494 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:09:54.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:09:54.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:54.859 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:54.859 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:50.361573+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:54.875 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:09:54.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:09:55.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:55.240 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:50.361573+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:09:55.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:09:55.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:09:55.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:09:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:34359738372 2024-04-26T12:09:55.447 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:09:55.451 INFO:teuthology.orchestra.run.smithi045.stdout:34359738372 2024-04-26T12:09:55.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:09:55.452 INFO:teuthology.orchestra.run.smithi045.stdout:34359738372 2024-04-26T12:09:55.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:09:55.846 INFO:teuthology.orchestra.run.smithi045.stdout:34359738371 2024-04-26T12:09:55.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2024-04-26T12:09:55.877 INFO:teuthology.orchestra.run.smithi045.stdout:34359738371 2024-04-26T12:09:55.879 INFO:teuthology.orchestra.run.smithi045.stdout:34359738371 2024-04-26T12:09:55.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2024-04-26T12:09:55.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2024-04-26T12:09:56.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:09:56.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:09:56.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:09:57.259 INFO:teuthology.orchestra.run.smithi045.stdout:34359738371 2024-04-26T12:09:57.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2024-04-26T12:09:57.293 INFO:teuthology.orchestra.run.smithi045.stdout:34359738371 2024-04-26T12:09:57.309 INFO:teuthology.orchestra.run.smithi045.stdout:34359738371 2024-04-26T12:09:57.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2024-04-26T12:09:57.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2024-04-26T12:09:58.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:09:58.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:09:58.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:09:58.662 INFO:teuthology.orchestra.run.smithi045.stdout:34359738372 2024-04-26T12:09:58.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2024-04-26T12:09:58.678 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:58.705 INFO:teuthology.orchestra.run.smithi045.stdout:34359738372 2024-04-26T12:09:58.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2024-04-26T12:09:58.721 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:58.743 INFO:teuthology.orchestra.run.smithi045.stdout:34359738372 2024-04-26T12:09:58.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2024-04-26T12:09:58.759 DEBUG:teuthology.parallel:result is None 2024-04-26T12:09:58.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:09:58.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:59.176 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:59.178 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:09:59.190 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T12:09:58.859498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.496781"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.865635+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:51.865635+0000","last_peered":"2024-04-26T12:09:51.865635+0000","last_clean":"2024-04-26T12:09:51.865635+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:51.865635+0000","last_undegraded":"2024-04-26T12:09:51.865635+0000","last_fullsized":"2024-04-26T12:09:51.865635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:59.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:09:59.603 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:09:59.604 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:09:59.617 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T12:09:58.859498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.496781"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.865635+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:51.865635+0000","last_peered":"2024-04-26T12:09:51.865635+0000","last_clean":"2024-04-26T12:09:51.865635+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:51.865635+0000","last_undegraded":"2024-04-26T12:09:51.865635+0000","last_fullsized":"2024-04-26T12:09:51.865635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:09:59.624 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:09:59.624 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:09:59.624 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:09:59.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:10:00.071 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:00.071 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:10:00.087 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:10:00.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:10:00.458 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:00.459 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:50.361573+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:10:00.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:09:47.482562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:09:48.344147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:10:00.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:10:00.842 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2024-04-26T12:10:00.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:10:01.223 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-04-26T12:10:01.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:10:01.606 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-04-26T12:10:01.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:10:01.988 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-04-26T12:10:02.004 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:10:02.422 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:02.422 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:09:49.360137+0000","modified":"2024-04-26T12:09:52.370114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:10:02.425 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-04-26T12:10:02.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:10:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:02.803 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:50.361573+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:10:02.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:09:47.482562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:09:48.344147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:10:02.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:10:03.183 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2024-04-26T12:10:03.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:10:03.567 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-04-26T12:10:03.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:10:03.948 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-04-26T12:10:03.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:10:04.324 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-04-26T12:10:04.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:10:04.758 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:04.758 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:09:49.360137+0000","modified":"2024-04-26T12:09:52.370114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:10:04.761 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-04-26T12:10:04.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:10:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:05.140 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:09:50.361573+0000","last_up_change":"2024-04-26T12:09:41.810744+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":40435},{"type":"v1","addr":"172.21.15.71:6801","nonce":40435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":40435},{"type":"v1","addr":"172.21.15.71:6803","nonce":40435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":40435},{"type":"v1","addr":"172.21.15.71:6807","nonce":40435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":40435},{"type":"v1","addr":"172.21.15.71:6805","nonce":40435}]},"public_addr":"172.21.15.71:6801/40435","cluster_addr":"172.21.15.71:6803/40435","heartbeat_back_addr":"172.21.15.71:6807/40435","heartbeat_front_addr":"172.21.15.71:6805/40435","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:10:05.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:10:05.573 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:05.573 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:09:49.360137+0000","modified":"2024-04-26T12:09:52.370114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:10:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-04-26T12:10:05.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T12:09:49.360137+0000', 'modified': '2024-04-26T12:09:52.370114+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6803/1004619672', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6802', 'nonce': 1004619672}, {'type': 'v1', 'addr': '172.21.15.45:6803', 'nonce': 1004619672}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T12:10:05.691 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T12:10:05.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T12:10:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-04-26T12:10:05.845+0000 7fb4e8ff9700 0 client.4480 ms_handle_reset on v2:172.21.15.45:6802/1004619672 2024-04-26T12:10:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-04-26T12:10:05.869+0000 7fb4e8ff9700 0 client.4486 ms_handle_reset on v2:172.21.15.45:6802/1004619672 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "238e0384-60e0-4b21-9d3a-782265888521", 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4190, 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 16.508174554, 2024-04-26T12:10:05.871 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 6, 2024-04-26T12:10:05.872 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 16, 2024-04-26T12:10:05.872 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 16, 2024-04-26T12:10:05.872 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 21.851844151000002 2024-04-26T12:10:05.872 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:10:05.885 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T12:10:05.900 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T12:10:05.900 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T12:10:05.900 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T12:10:05.900 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T12:10:05.900 DEBUG:teuthology.orchestra.run.smithi045:> sync 2024-04-26T12:10:06.041 DEBUG:teuthology.orchestra.run.smithi071:> sync 2024-04-26T12:10:06.162 DEBUG:teuthology.orchestra.run.smithi094:> sync 2024-04-26T12:10:06.249 DEBUG:teuthology.orchestra.run.smithi104:> sync 2024-04-26T12:10:06.341 DEBUG:tasks.thrashosds:checking console status of smithi045 2024-04-26T12:10:06.342 DEBUG:teuthology.orchestra.console.smithi045:Waiting for login prompt 2024-04-26T12:10:06.342 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi045 2024-04-26T12:10:06.522 DEBUG:teuthology.orchestra.console.smithi045:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:10:06.522 DEBUG:teuthology.orchestra.console.smithi045:expect after: smithi045 login: 2024-04-26T12:10:06.575 DEBUG:teuthology.orchestra.console.smithi045:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi045 login: [disconnect] 2024-04-26T12:10:06.676 DEBUG:tasks.thrashosds:checking console status of smithi071 2024-04-26T12:10:06.676 DEBUG:teuthology.orchestra.console.smithi071:Waiting for login prompt 2024-04-26T12:10:06.676 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi071 2024-04-26T12:10:06.823 DEBUG:teuthology.orchestra.console.smithi071:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:10:06.823 DEBUG:teuthology.orchestra.console.smithi071:expect after: smithi071 login: 2024-04-26T12:10:06.875 DEBUG:teuthology.orchestra.console.smithi071:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi071 login: [disconnect] 2024-04-26T12:10:06.976 DEBUG:tasks.thrashosds:checking console status of smithi094 2024-04-26T12:10:06.976 DEBUG:teuthology.orchestra.console.smithi094:Waiting for login prompt 2024-04-26T12:10:06.976 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi094 2024-04-26T12:10:07.076 DEBUG:teuthology.orchestra.console.smithi094:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:10:07.076 DEBUG:teuthology.orchestra.console.smithi094:expect after: smithi094 login: 2024-04-26T12:10:07.128 DEBUG:teuthology.orchestra.console.smithi094:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi094 login: [disconnect] 2024-04-26T12:10:07.229 DEBUG:tasks.thrashosds:checking console status of smithi104 2024-04-26T12:10:07.230 DEBUG:teuthology.orchestra.console.smithi104:Waiting for login prompt 2024-04-26T12:10:07.230 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi104 2024-04-26T12:10:07.424 DEBUG:teuthology.orchestra.console.smithi104:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:10:07.424 DEBUG:teuthology.orchestra.console.smithi104:expect after: smithi104 login: 2024-04-26T12:10:07.476 DEBUG:teuthology.orchestra.console.smithi104:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi104 login: [disconnect] 2024-04-26T12:10:07.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T12:10:07.974 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T12:10:07.974 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:10:07.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:08.346 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:10:08.356 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T12:10:06.861196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.865635+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:51.865635+0000","last_peered":"2024-04-26T12:09:51.865635+0000","last_clean":"2024-04-26T12:09:51.865635+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:51.865635+0000","last_undegraded":"2024-04-26T12:09:51.865635+0000","last_fullsized":"2024-04-26T12:09:51.865635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:08.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:10:08.783 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T12:10:06.861196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.865635+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:51.865635+0000","last_peered":"2024-04-26T12:09:51.865635+0000","last_clean":"2024-04-26T12:09:51.865635+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:51.865635+0000","last_undegraded":"2024-04-26T12:09:51.865635+0000","last_fullsized":"2024-04-26T12:09:51.865635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:08.787 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:10:08.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T12:10:09.193 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 16 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 238e0384-60e0-4b21-9d3a-782265888521 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-04-26T12:09:34.034413+0000 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-04-26T12:09:50.361573+0000 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:crush_version 4 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:full_ratio 0.95 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:backfillfull_ratio 0.9 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:nearfull_ratio 0.85 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:require_min_compat_client luminous 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:min_compat_client jewel 2024-04-26T12:10:09.194 INFO:teuthology.orchestra.run.smithi045.stdout:require_osd_release reef 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:stretch_mode_enabled false 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:max_osd 3 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/40435,v1:172.21.15.71:6801/40435] [v2:172.21.15.71:6802/40435,v1:172.21.15.71:6803/40435] exists,up f5e89d15-234b-43fa-a34c-aa6987125af4 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6800/40365,v1:172.21.15.94:6801/40365] [v2:172.21.15.94:6802/40365,v1:172.21.15.94:6803/40365] exists,up cacdbf9c-7e2f-46fa-9e34-804a2afdb53a 2024-04-26T12:10:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.104:6800/40673,v1:172.21.15.104:6801/40673] [v2:172.21.15.104:6802/40673,v1:172.21.15.104:6803/40673] exists,up 406b2884-83cb-4c28-885d-e6f9a3d25330 2024-04-26T12:10:09.210 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/40435,v1:172.21.15.71:6801/40435] [v2:172.21.15.71:6802/40435,v1:172.21.15.71:6803/40435] exists,up f5e89d15-234b-43fa-a34c-aa6987125af4', 'osd.1 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.94:6800/40365,v1:172.21.15.94:6801/40365] [v2:172.21.15.94:6802/40365,v1:172.21.15.94:6803/40365] exists,up cacdbf9c-7e2f-46fa-9e34-804a2afdb53a', 'osd.2 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.104:6800/40673,v1:172.21.15.104:6801/40673] [v2:172.21.15.104:6802/40673,v1:172.21.15.104:6803/40673] exists,up 406b2884-83cb-4c28-885d-e6f9a3d25330'] 2024-04-26T12:10:09.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mon.a", 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster": "ceph", 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: "admin_socket_mode": "", 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T12:10:09.347 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_client_required": "cephx, none", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_cluster_required": "cephx", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_debug": "true", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_service_required": "cephx", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_supported": "cephx", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_aio": "true", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_aio_reap_max": "16", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_async_discard": "false", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_block_size": "4096", 2024-04-26T12:10:09.348 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_debug_aio": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_enable_discard": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_flock_retry": "3", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_inject_crash": "0", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_ioring": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_ioring_hipri": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T12:10:09.349 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bdev_type": "", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_allocator": "hybrid", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_buffered_io": "true", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T12:10:09.350 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_replay_recovery": "false", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_sync_write": "false", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_allocator": "hybrid", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T12:10:09.351 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_create": "true", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_db_create": "false", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_db_path": "", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_db_size": "0", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_path": "", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_size": "107374182400", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_wal_create": "false", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_wal_path": "", 2024-04-26T12:10:09.352 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_bluefs": "true", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_autotune": "true", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T12:10:09.353 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_size": "0", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_type": "2q", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_clone_cow": "true", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T12:10:09.354 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_mode": "none", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_freelist": "false", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T12:10:09.355 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T12:10:09.356 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fail_eio": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T12:10:09.357 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T12:10:09.358 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_max_blob_size": "0", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T12:10:09.359 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_spdk_mem": "512", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T12:10:09.360 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_tracing": "false", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T12:10:09.361 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T12:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T12:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T12:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T12:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T12:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T12:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_cluster_require_version": "2", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_require_signatures": "false", 2024-04-26T12:10:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_require_version": "2", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_service_require_signatures": "false", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_service_require_version": "2", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "cephx_sign_messages": "true", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "chdir": "", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_acl_type": "", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_asio_thread_count": "2", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_cache_mid": "0.750000", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_cache_size": "16384", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_caps_release_delay": "5", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_check_pool_perm": "true", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_debug_force_sync_read": "false", 2024-04-26T12:10:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "client_debug_getattr_caps": "false", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_die_on_failed_remount": "false", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_dirsize_rbytes": "true", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_force_lazyio": "false", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_fs": "", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_inject_release_failure": "false", 2024-04-26T12:10:09.365 INFO:teuthology.orchestra.run.smithi045.stdout: "client_max_inline_size": "4096", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_mds_namespace": "", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_metadata": "", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_mount_gid": "-1", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_mount_timeout": "300", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_mount_uid": "-1", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_mountpoint": "/", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_notify_timeout": "10", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_oc": "true", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_oc_max_objects": "1000", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_oc_size": "209715200", 2024-04-26T12:10:09.366 INFO:teuthology.orchestra.run.smithi045.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_permissions": "true", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_quota": "true", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_quota_df": "true", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_readahead_max_bytes": "0", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_readahead_max_periods": "4", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_readahead_min": "131072", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_reconnect_stale": "false", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_shutdown_timeout": "30", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_snapdir": ".snap", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_tick_interval": "1", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_trace": "", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_use_faked_inos": "false", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "client_use_random_mds": "false", 2024-04-26T12:10:09.367 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_graylog": "false", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_graylog_port": "12201", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_monitors": "default=true", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_syslog": "false", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "clog_to_syslog_level": "info", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "-", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_network": "", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_network_interface": "", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "compressor_zlib_isal": "false", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "compressor_zlib_level": "5", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "compressor_zstd_level": "1", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T12:10:09.368 INFO:teuthology.orchestra.run.smithi045.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crimson_seastar_smp": "1", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_location": "", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_location_hook": "", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_location_hook_timeout": "10", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "daemonize": "false", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "daos_pool": "tank", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_alienstore": "0/5", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T12:10:09.369 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_asok": "1/5", 2024-04-26T12:10:09.370 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_asok_assert_abort": "false", 2024-04-26T12:10:09.370 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T12:10:09.370 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_auth": "20/20", 2024-04-26T12:10:09.370 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_bdev": "1/3", 2024-04-26T12:10:09.370 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_bluefs": "1/5", 2024-04-26T12:10:09.370 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_bluestore": "1/5", 2024-04-26T12:10:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_buffer": "0/1", 2024-04-26T12:10:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T12:10:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T12:10:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_cephsqlite": "0/5", 2024-04-26T12:10:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_client": "0/5", 2024-04-26T12:10:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_compressor": "1/5", 2024-04-26T12:10:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_context": "0/1", 2024-04-26T12:10:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_crush": "1/1", 2024-04-26T12:10:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_crypto": "1/5", 2024-04-26T12:10:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_cyanstore": "0/5", 2024-04-26T12:10:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T12:10:09.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T12:10:09.373 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_dpdk": "1/5", 2024-04-26T12:10:09.373 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_eventtrace": "1/5", 2024-04-26T12:10:09.373 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_filer": "0/1", 2024-04-26T12:10:09.373 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_filestore": "1/3", 2024-04-26T12:10:09.373 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_finisher": "1/1", 2024-04-26T12:10:09.373 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_fuse": "1/5", 2024-04-26T12:10:09.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T12:10:09.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T12:10:09.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T12:10:09.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_javaclient": "1/5", 2024-04-26T12:10:09.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_journal": "1/3", 2024-04-26T12:10:09.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_journaler": "0/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_kstore": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_leveldb": "4/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_lockdep": "0/1", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mclock": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mds": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mds_balancer": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mds_locker": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mds_log": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T12:10:09.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mds_migrator": "1/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_memstore": "1/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mgr": "2/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mgrc": "1/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_mon": "20/20", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_monc": "0/10", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_ms": "1/1", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_none": "0/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_objclass": "0/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_objectcacher": "0/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_objecter": "0/1", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_optracker": "0/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_osd": "1/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_paxos": "20/20", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_perfcounter": "1/5", 2024-04-26T12:10:09.376 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_prioritycache": "1/5", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rados": "0/5", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rbd": "0/5", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rbd_replay": "0/5", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_refs": "0/0", 2024-04-26T12:10:09.377 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_reserver": "1/1", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rgw": "1/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rgw_access": "1/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rgw_flight": "1/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rgw_sync": "1/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_rocksdb": "4/5", 2024-04-26T12:10:09.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_backref": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_cache": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_device": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_epm": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_journal": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_lba": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_odata": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_omap": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_onode": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_t": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_seastore_tm": "0/5", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_striper": "0/1", 2024-04-26T12:10:09.379 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_test": "0/5", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_throttle": "1/1", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_timer": "0/1", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "debug_tp": "0/5", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "device_failure_prediction_mode": "none", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "err_to_graylog": "false", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "err_to_journald": "false", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "err_to_stderr": "true", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "err_to_syslog": "false", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "event_tracing": "false", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T12:10:09.380 INFO:teuthology.orchestra.run.smithi045.stdout: "exporter_http_port": "9926", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "exporter_prio_limit": "5", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "exporter_sort_metrics": "true", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "exporter_stats_period": "5", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "fake_statfs_for_testing": "0", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "fatal_signal_handlers": "true", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filer_max_purge_ops": "10", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filer_max_truncate_ops": "128", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_blackhole": "false", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_btrfs_snap": "true", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_caller_concurrency": "10", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T12:10:09.381 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_debug_omap_check": "false", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_debug_verify_split": "false", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_dump_file": "", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fadvise": "true", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fail_eio": "true", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T12:10:09.382 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fd_cache_size": "128", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fiemap": "false", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_inject_stall": "0", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_journal_parallel": "false", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_journal_trailing": "false", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_journal_writeahead": "false", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_kill_at": "0", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T12:10:09.383 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_merge_threshold": "-10", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_odsync_write": "false", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_omap_backend_path": "", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T12:10:09.384 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_op_threads": "2", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_punch_hole": "false", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_queue_max_ops": "50", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T12:10:09.385 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_seek_data_hole": "false", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_sloppy_crc": "false", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_splice": "false", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_split_multiple": "2", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_split_rand_factor": "20", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_update_to": "1000", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T12:10:09.386 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_xfs_extsize": "false", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "filestore_zfs_snap": "false", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fio_dir": "/tmp/fio", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "238e0384-60e0-4b21-9d3a-782265888521", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_allow_other": "true", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_big_writes": "true", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_debug": "false", 2024-04-26T12:10:09.387 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_default_permissions": "false", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_disable_pagecache": "false", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_max_write": "0", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_multithreaded": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_require_active_mds": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_set_user_groups": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_splice_move": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_splice_read": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_splice_write": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T12:10:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "gss_target_name": "ceph", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_file": "", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_inject_failure": "0", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_interval": "5", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "host": "smithi045", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T12:10:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "inject_early_sigterm": "false", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "jaeger_agent_port": "6799", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "jaeger_tracing_enable": "false", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_aio": "true", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_align_min_size": "65536", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_block_align": "true", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_block_size": "4096", 2024-04-26T12:10:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_dio": "true", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_discard": "false", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_force_aio": "false", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_ignore_corruption": "false", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_max_write_entries": "100", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_replay_from": "0", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T12:10:09.391 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_write_header_frequency": "0", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "journal_zero_on_create": "false", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "journaler_prefetch_periods": "10", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "journaler_prezero_periods": "5", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "journaler_write_head_interval": "15", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "keyfile": "", 2024-04-26T12:10:09.392 INFO:teuthology.orchestra.run.smithi045.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T12:10:09.393 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_backend": "rocksdb", 2024-04-26T12:10:09.393 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T12:10:09.393 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T12:10:09.393 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T12:10:09.393 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_max_bytes": "67108864", 2024-04-26T12:10:09.393 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_max_ops": "512", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_onode_map_size": "1024", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "kstore_sync_transaction": "false", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_block_size": "65536", 2024-04-26T12:10:09.394 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_bloom_size": "0", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_cache_size": "536870912", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_compression": "false", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_log": "", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_max_open_files": "0", 2024-04-26T12:10:09.395 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_paranoid": "false", 2024-04-26T12:10:09.396 INFO:teuthology.orchestra.run.smithi045.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T12:10:09.396 INFO:teuthology.orchestra.run.smithi045.stdout: "librados_thread_count": "2", 2024-04-26T12:10:09.396 INFO:teuthology.orchestra.run.smithi045.stdout: "lockdep": "false", 2024-04-26T12:10:09.396 INFO:teuthology.orchestra.run.smithi045.stdout: "lockdep_force_backtrace": "false", 2024-04-26T12:10:09.396 INFO:teuthology.orchestra.run.smithi045.stdout: "log_coarse_timestamps": "true", 2024-04-26T12:10:09.396 INFO:teuthology.orchestra.run.smithi045.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T12:10:09.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_flush_on_exit": "false", 2024-04-26T12:10:09.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T12:10:09.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_graylog_port": "12201", 2024-04-26T12:10:09.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_max_new": "1000", 2024-04-26T12:10:09.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_max_recent": "10000", 2024-04-26T12:10:09.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_stderr_prefix": "", 2024-04-26T12:10:09.398 INFO:teuthology.orchestra.run.smithi045.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T12:10:09.398 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": "true", 2024-04-26T12:10:09.398 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_graylog": "false", 2024-04-26T12:10:09.398 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_journald": "false", 2024-04-26T12:10:09.398 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_stderr": "false", 2024-04-26T12:10:09.399 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_syslog": "false", 2024-04-26T12:10:09.399 INFO:teuthology.orchestra.run.smithi045.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T12:10:09.399 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T12:10:09.399 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_action_on_write_error": "1", 2024-04-26T12:10:09.399 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_alternate_name_max": "8192", 2024-04-26T12:10:09.399 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_asio_thread_count": "2", 2024-04-26T12:10:09.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_export_pin": "true", 2024-04-26T12:10:09.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T12:10:09.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T12:10:09.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T12:10:09.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T12:10:09.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_interval": "10", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_max": "-1", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_max_until": "-1", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_merge_size": "50", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_mode": "0", 2024-04-26T12:10:09.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_split_bits": "3", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_split_size": "10000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T12:10:09.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_mid": "0.700000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_trim_interval": "1", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_debug_auth_pins": "false", 2024-04-26T12:10:09.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_debug_frag": "false", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_debug_scatterstat": "false", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_debug_subtrees": "false", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_default_dir_hash": "2", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_defer_session_stale": "true", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dir_max_entries": "0", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dir_prefetch": "true", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T12:10:09.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_early_reply": "true", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_enable_op_tracker": "true", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_enforce_unique_name": "true", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T12:10:09.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_inject_health_dummy": "false", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_join_fs": "", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_journal_format": "1", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_create_at": "0", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_export_at": "0", 2024-04-26T12:10:09.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_import_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_journal_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_link_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_openc_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_rename_at": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_max_events": "-1", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_max_segments": "128", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_pause": "false", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_segment_size": "0", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T12:10:09.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_completed_requests": "100000", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_export_size": "20971520", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_file_recover": "32", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_purge_files": "64", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_purge_ops": "8192", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_metrics_update_interval": "2", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_min_caps_per_client": "100", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T12:10:09.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_numa_node": "-1", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_op_history_duration": "600", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_op_history_size": "20", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_op_log_threshold": "5", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_ping_grace": "15", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_ping_interval": "5", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_recall_max_caps": "30000", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T12:10:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_replay_interval": "1.000000", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_root_ino_gid": "0", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_root_ino_uid": "0", 2024-04-26T12:10:09.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T12:10:09.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T12:10:09.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T12:10:09.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T12:10:09.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T12:10:09.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T12:10:09.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T12:10:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T12:10:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T12:10:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T12:10:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_shutdown_check": "0", 2024-04-26T12:10:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_skip_ino": "0", 2024-04-26T12:10:09.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_snap_min_uid": "0", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_snap_rstat": "false", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_symlink_recovery": "true", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_thrash_exports": "0", 2024-04-26T12:10:09.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_thrash_fragments": "0", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_tick_interval": "5.000000", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_valgrind_exit": "false", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_verify_backtrace": "1", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_verify_scatter": "false", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_wipe_sessions": "false", 2024-04-26T12:10:09.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool_debug": "false", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "memstore_page_set": "false", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "memstore_page_size": "65536", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_client_bytes": "134217728", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_client_messages": "512", 2024-04-26T12:10:09.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_disabled_modules": "", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T12:10:09.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_mds_messages": "128", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_mon_messages": "128", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_osd_messages": "8192", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_pool": "true", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_standby_modules": "true", 2024-04-26T12:10:09.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_stats_period": "5", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_stats_threshold": "5", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_tick_period": "2", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_allow_pool_delete": "true", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T12:10:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_bytes": "104857600", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T12:10:09.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T12:10:09.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T12:10:09.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T12:10:09.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T12:10:09.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T12:10:09.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_compact_on_start": "false", 2024-04-26T12:10:09.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_compact_on_trim": "true", 2024-04-26T12:10:09.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_cpu_threads": "4", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T12:10:09.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_data_avail_crit": "5", 2024-04-26T12:10:09.424 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_data_avail_warn": "5", 2024-04-26T12:10:09.424 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T12:10:09.424 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T12:10:09.424 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T12:10:09.424 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_dump_json": "false", 2024-04-26T12:10:09.424 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_extra_checks": "false", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T12:10:09.425 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_election_default_strategy": "1", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_election_timeout": "5.000000", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T12:10:09.426 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_enable_op_tracker": "true", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_fake_pool_delete": "false", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_force_quorum_join": "false", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_health_log_update_period": "5", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_health_max_detail": "50", 2024-04-26T12:10:09.427 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_health_to_clog": "true", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_host": "172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790],[v2:172.21.15.45:3302,v1:172.21.15.45:6791]", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_host_override": "", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_initial_members": "", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T12:10:09.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_lease": "5.000000", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_log_full_interval": "50", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_log_max": "10000", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_log_max_summary": "50", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_log_epochs": "500", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_osd": "10000", 2024-04-26T12:10:09.429 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_memory_autotune": "true", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_memory_target": "2147483648", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mgr_digest_period": "5", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T12:10:09.430 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_op_complaint_time": "30", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_op_history_duration": "600", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_op_history_size": "20", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_op_log_threshold": "5", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T12:10:09.431 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_cache_size": "500", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T12:10:09.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_report_timeout": "900", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T12:10:09.433 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_reweight_max_osds": "4", 2024-04-26T12:10:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_scrub_interval": "86400", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_scrub_max_keys": "100", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_scrub_timeout": "300", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_session_timeout": "300", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_smart_report_timeout": "5", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_stretch_pool_size": "4", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T12:10:09.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_sync_debug": "false", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_tick_interval": "5", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T12:10:09.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_older_version": "true", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T12:10:09.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "monmap": "", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "motr_tracing_enabled": "false", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_op_threads": "3", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_cm": "false", 2024-04-26T12:10:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_device_name": "", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_sl": "3", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T12:10:09.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_rdma_type": "ib", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_async_reap_threshold": "5", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_before_connect": "false", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_ipv4": "true", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_ipv6": "false", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_msgr1": "true", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_msgr2": "true", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_port_max": "7568", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_port_min": "6800", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_retry_count": "3", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_bind_retry_delay": "5", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_blackhole_client": "false", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_blackhole_mds": "false", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_blackhole_mgr": "false", 2024-04-26T12:10:09.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_blackhole_mon": "false", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_blackhole_osd": "false", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_client_mode": "crc secure", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_cluster_type": "", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_compress_secure": "false", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_crc_data": "true", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_crc_header": "true", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_die_on_bug": "true", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_die_on_old_message": "true", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T12:10:09.441 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_hugepages": "", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_lro": "true", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T12:10:09.442 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_pmd": "", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_port_id": "0", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_dump_on_send": "false", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_inject_delay_type": "", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_inject_network_congestion": "0", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_inject_socket_failures": "0", 2024-04-26T12:10:09.443 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_max_accept_failures": "4", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_max_backoff": "15.000000", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_osd_compress_mode": "none", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_pq_min_cost": "65536", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_public_type": "", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_service_mode": "crc secure", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T12:10:09.444 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_tcp_nodelay": "true", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "ms_type": "async+posix", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "no_config_file": "false", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_inflight_ops": "1024", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T12:10:09.445 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter_timeout": "10.000000", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "objectstore_blackhole": "false", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "openssl_engine_opts": "", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_max_ops": "4", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T12:10:09.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_agent_slop": "0.020000", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_asio_thread_count": "2", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_backfill_scan_max": "512", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_backfill_scan_min": "64", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_backoff_on_peering": "false", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_beacon_report_interval": "300", 2024-04-26T12:10:09.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bench_duration": "30", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_blkin_trace_all": "false", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:10:09.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_class_update_on_start": "true", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_client_message_cap": "256", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_client_op_priority": "63", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_client_watch_timeout": "30", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_command_max_records": "256", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_compact_on_start": "false", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_crush_update_on_start": "true", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T12:10:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_op_order": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T12:10:09.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_shutdown": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T12:10:09.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_default_notify_timeout": "30", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_enable_op_tracker": "true", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_fast_info": "true", 2024-04-26T12:10:09.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_fast_shutdown": "true", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_function_tracing": "false", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_grace": "20", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_interval": "6", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_stale": "600", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T12:10:09.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_journal_size": "5120", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_kill_backfill_at": "0", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_map_cache_size": "50", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_map_dedup": "true", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_map_message_max": "40", 2024-04-26T12:10:09.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_attr_name_len": "100", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_attr_size": "0", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_backfills": "1", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_markdown_count": "5", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_markdown_period": "600", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_object_name_len": "2048", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_object_size": "134217728", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T12:10:09.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_pgls": "1024", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_push_cost": "8388608", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_push_objects": "10", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_scrubs": "3", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_max_write_size": "90", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T12:10:09.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_profile": "balanced", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_base": "805306368", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T12:10:09.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_target": "4294967296", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_target_autotune": "false", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_min_recovery_priority": "0", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mon_report_interval": "5", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_num_cache_shards": "32", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T12:10:09.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_numa_node": "-1", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_objecter_finishers": "1", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_objectstore": "bluestore", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_objectstore_fuse": "false", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_objectstore_tracing": "false", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_history_duration": "600", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_history_size": "20", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_log_threshold": "5", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_num_shards": "0", 2024-04-26T12:10:09.459 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_op_thread_timeout": "15", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_open_classes_on_start": "true", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_os_flags": "0", 2024-04-26T12:10:09.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_peering_op_priority": "255", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_delete_priority": "5", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T12:10:09.461 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_crimson": "false", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_flags": "0", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T12:10:09.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_min_size": "0", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_size": "2", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_default_type": "replicated", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_cost": "20971520", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T12:10:09.463 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_max_active": "0", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_op_priority": "3", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_priority": "5", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_repair_during_recovery": "false", 2024-04-26T12:10:09.464 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_cost": "52428800", 2024-04-26T12:10:09.465 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_end_hour": "0", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_priority": "5", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T12:10:09.466 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_skip_data_digest": "false", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_smart_report_timeout": "5", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_snap_trim_priority": "5", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T12:10:09.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_target_transaction_size": "30", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_tracing": "false", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_use_stale_snap": "false", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T12:10:09.468 INFO:teuthology.orchestra.run.smithi045.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_kill_at": "0", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_max_join_drift": "10", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_min": "500", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_min_wait": "0.050000", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_service_trim_max": "500", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_service_trim_min": "250", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_stash_full_interval": "25", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_trim_max": "500", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "paxos_trim_min": "250", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "perf": "true", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T12:10:09.469 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "-", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrv": "", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "public_bind_addr": "-", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "public_network": "", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "public_network_interface": "", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "qat_compressor_enabled": "false", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rados_mon_op_timeout": "0", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rados_osd_op_timeout": "0", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rados_tracing": "false", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_atime_update_interval": "60", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T12:10:09.470 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache": "true", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T12:10:09.471 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_policy": "writearound", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_size": "33554432", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_compression_hint": "none", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T12:10:09.472 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_clone_format": "auto", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_data_pool": "", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_features": "61", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_format": "2", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_map_options": "", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_order": "22", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_pool": "rbd", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_stripe_count": "0", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T12:10:09.473 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_io_scheduler": "simple", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T12:10:09.474 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_order": "24", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_pool": "", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_journal_splay_width": "4", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T12:10:09.475 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T12:10:09.476 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T12:10:09.477 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_op_threads": "1", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_plugins": "", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T12:10:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T12:10:09.479 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_tracing": "false", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_validate_names": "true", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_validate_pool": "true", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "restapi_base_url": "", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "restapi_log_level": "", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T12:10:09.480 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_admin_entry": "admin", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_backend_store": "rados", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_barbican_url": "", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_beast_enable_async": "true", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_cache_enabled": "true", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T12:10:09.481 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_config_store": "rados", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_content_length_compat": "false", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_cross_domain_policy": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T12:10:09.482 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T12:10:09.483 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T12:10:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T12:10:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_log_window": "30", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T12:10:09.486 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T12:10:09.487 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T12:10:09.488 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T12:10:09.488 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T12:10:09.488 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T12:10:09.488 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dns_name": "", 2024-04-26T12:10:09.488 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dns_s3website_name": "", 2024-04-26T12:10:09.488 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_ops_log": "false", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_static_website": "false", 2024-04-26T12:10:09.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enable_usage_log": "false", 2024-04-26T12:10:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T12:10:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T12:10:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_expose_bucket": "false", 2024-04-26T12:10:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_extended_http_attrs": "", 2024-04-26T12:10:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_filter": "none", 2024-04-26T12:10:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T12:10:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T12:10:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T12:10:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T12:10:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T12:10:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_max_objs": "32", 2024-04-26T12:10:09.491 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T12:10:09.492 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_init_timeout": "300", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T12:10:09.493 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T12:10:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_password": "", 2024-04-26T12:10:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T12:10:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_project": "", 2024-04-26T12:10:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T12:10:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_token": "", 2024-04-26T12:10:09.494 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T12:10:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_admin_user": "", 2024-04-26T12:10:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_api_version": "2", 2024-04-26T12:10:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T12:10:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T12:10:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T12:10:09.495 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T12:10:09.496 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_url": "", 2024-04-26T12:10:09.497 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T12:10:09.497 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T12:10:09.497 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T12:10:09.497 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_max_objs": "32", 2024-04-26T12:10:09.497 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T12:10:09.497 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_max_worker": "3", 2024-04-26T12:10:09.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T12:10:09.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T12:10:09.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T12:10:09.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T12:10:09.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T12:10:09.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T12:10:09.499 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T12:10:09.499 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T12:10:09.499 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T12:10:09.499 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T12:10:09.499 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T12:10:09.499 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_log_http_headers": "", 2024-04-26T12:10:09.500 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T12:10:09.500 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T12:10:09.500 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T12:10:09.500 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T12:10:09.500 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T12:10:09.500 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_attr_size": "0", 2024-04-26T12:10:09.501 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T12:10:09.501 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T12:10:09.501 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T12:10:09.501 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T12:10:09.501 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T12:10:09.501 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_listing_results": "1000", 2024-04-26T12:10:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_notify_retries": "10", 2024-04-26T12:10:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T12:10:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T12:10:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T12:10:09.505 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T12:10:09.505 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T12:10:09.506 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T12:10:09.506 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T12:10:09.506 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T12:10:09.506 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T12:10:09.506 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T12:10:09.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T12:10:09.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T12:10:09.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T12:10:09.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T12:10:09.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T12:10:09.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T12:10:09.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_num_control_oids": "8", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_numa_node": "-1", 2024-04-26T12:10:09.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T12:10:09.510 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T12:10:09.510 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_op_tracing": "false", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_opa_token": "", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_opa_url": "", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T12:10:09.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ops_log_rados": "false", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_print_continue": "true", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T12:10:09.512 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_rados_tracing": "false", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_realm": "", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_realm_id": "", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_region": "", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_request_uri": "", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T12:10:09.513 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_resolve_cname": "false", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_run_sync_thread": "true", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T12:10:09.514 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_script_uri": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_service_provider_name": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_client_id": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_client_secret": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_entry": "sts", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_key": "sts", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_auth_url": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_custom_header": "", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T12:10:09.515 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_need_stats": "true", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_tenant_name": "", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_url": "", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_lease_period": "120", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T12:10:09.516 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_thread_pool_size": "512", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_comment": "", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_createby": "", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_encoding": "", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_flag": "false", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_origin": "", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_torrent_tracker": "", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T12:10:09.517 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_usage_max_shards": "32", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_use_opa_authz": "false", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_user_unique_email": "true", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_verify_ssl": "true", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T12:10:09.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_zone": "", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_zone_id": "", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_zonegroup": "", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_zonegroup_id": "", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_block_size": "4096", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T12:10:09.519 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T12:10:09.520 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_partition_filters": "false", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_perf": "false", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "run_dir": "/var/run/ceph", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_block_create": "true", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T12:10:09.521 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_device_size": "53687091200", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_main_device_type": "SSD", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "seastore_segment_size": "67108864", 2024-04-26T12:10:09.522 INFO:teuthology.orchestra.run.smithi045.stdout: "set_keepcaps": "false", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "setgroup": "", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "setuser": "", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "setuser_match_path": "", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "thp": "false", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "threadpool_default_timeout": "60", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout: "throttler_perf_counter": "true" 2024-04-26T12:10:09.523 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:10:09.526 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T12:10:09.686 INFO:teuthology.orchestra.run.smithi045.stdout:mon.a: {} 2024-04-26T12:10:09.696 INFO:teuthology.orchestra.run.smithi045.stdout:mon.b: {} 2024-04-26T12:10:09.706 INFO:teuthology.orchestra.run.smithi045.stdout:mon.c: {} 2024-04-26T12:10:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:10:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:10:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:10:09.720 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T12:10:09.721 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-26T12:10:09.732 INFO:tasks.radosbench:Beginning radosbench... 2024-04-26T12:10:09.732 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-26T12:10:09.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-26T12:10:09.733 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T12:10:09.733 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:10:09.733 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:09.733 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T12:10:09.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:10:09.734 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T12:10:09.734 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T12:10:09.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:09.735 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T12:10:09.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:09.735 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T12:10:09.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:10:09.738 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:09.735+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:09.836 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:09.836+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:09.879 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:09.880 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:09.880 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-26T12:10:09.880 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:09.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:09.919 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:09.937 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:09.937+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:09.942 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:09.963 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:09.964 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:09.965 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:09.965 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:10.017 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.017 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:10.038 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:10.037+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:10.140 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:10.139+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:10.155 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.155 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.165 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:10.178 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:10.178 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 16, 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "238e0384-60e0-4b21-9d3a-782265888521", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2024-04-26T12:09:34.034413+0000", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2024-04-26T12:09:50.361573+0000", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2024-04-26T12:09:41.810744+0000", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2024-04-26T12:09:34.969233+0000", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2024-04-26T12:10:10.179 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 4, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 3, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:42.899365+0000", 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:10.181 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:10.182 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2024-04-26T12:10:10.182 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "11", 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:10.183 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:10.184 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:10.185 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:10.186 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:42.935107+0000", 2024-04-26T12:10:10.187 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2024-04-26T12:10:10.188 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "12", 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:10.189 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:10.190 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:10.191 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:10.192 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 3, 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:47.482562+0000", 2024-04-26T12:10:10.193 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2024-04-26T12:10:10.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "15", 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:10.195 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:10.196 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:10.197 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 4, 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2024-04-26T12:10:10.199 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:48.344147+0000", 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2024-04-26T12:10:10.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "16", 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:10.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:10.203 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2024-04-26T12:10:10.204 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:10.205 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "f5e89d15-234b-43fa-a34c-aa6987125af4", 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 14, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:10.206 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6800", 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6801", 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.207 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6802", 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6803", 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:10.208 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6806", 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6807", 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:10.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6804", 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6805", 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.71:6801/40435", 2024-04-26T12:10:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.71:6803/40435", 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.71:6807/40435", 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.71:6805/40435", 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "cacdbf9c-7e2f-46fa-9e34-804a2afdb53a", 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:10.211 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 14, 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6800", 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6801", 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.212 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6802", 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.213 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6803", 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6806", 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.214 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6807", 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6804", 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.215 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6805", 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.94:6801/40365", 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.94:6803/40365", 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.94:6807/40365", 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.94:6805/40365", 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:10.216 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "406b2884-83cb-4c28-885d-e6f9a3d25330", 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 14, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.217 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6800", 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6801", 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.218 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6802", 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6803", 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6806", 2024-04-26T12:10:10.219 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6807", 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6804", 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6805", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.104:6801/40673", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.104:6803/40673", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.104:6807/40673", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.104:6805/40673", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.221 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.032022+0000", 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:10.222 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.017304+0000", 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:10.223 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.048371+0000", 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2024-04-26T12:10:10.224 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:10.225 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:10:10.227 INFO:tasks.thrashosds.thrasher:j is {'epoch': 16, 'fsid': '238e0384-60e0-4b21-9d3a-782265888521', 'created': '2024-04-26T12:09:34.034413+0000', 'modified': '2024-04-26T12:09:50.361573+0000', 'last_up_change': '2024-04-26T12:09:41.810744+0000', 'last_in_change': '2024-04-26T12:09:34.969233+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:09:47.482562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:09:48.344147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f5e89d15-234b-43fa-a34c-aa6987125af4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 14, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6801', 'nonce': 40435}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 40435}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6807', 'nonce': 40435}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6805', 'nonce': 40435}]}, 'public_addr': '172.21.15.71:6801/40435', 'cluster_addr': '172.21.15.71:6803/40435', 'heartbeat_back_addr': '172.21.15.71:6807/40435', 'heartbeat_front_addr': '172.21.15.71:6805/40435', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'cacdbf9c-7e2f-46fa-9e34-804a2afdb53a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 14, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6800', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6801', 'nonce': 40365}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6802', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6803', 'nonce': 40365}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6806', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6807', 'nonce': 40365}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6804', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6805', 'nonce': 40365}]}, 'public_addr': '172.21.15.94:6801/40365', 'cluster_addr': '172.21.15.94:6803/40365', 'heartbeat_back_addr': '172.21.15.94:6807/40365', 'heartbeat_front_addr': '172.21.15.94:6805/40365', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '406b2884-83cb-4c28-885d-e6f9a3d25330', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 14, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6800', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6801', 'nonce': 40673}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6802', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6803', 'nonce': 40673}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6806', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6807', 'nonce': 40673}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6804', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6805', 'nonce': 40673}]}, 'public_addr': '172.21.15.104:6801/40673', 'cluster_addr': '172.21.15.104:6803/40673', 'heartbeat_back_addr': '172.21.15.104:6807/40673', 'heartbeat_front_addr': '172.21.15.104:6805/40673', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.032022+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.017304+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.048371+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:10:10.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:10.240 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:10.239+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:10.314 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.315 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.320 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:10.340 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:10.340+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'unique_pool_0' created 2024-04-26T12:10:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:10:10.440 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-26T12:10:10.442 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:10.441+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:10.448 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.448 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.458 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:10.542 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:10.541+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:10.586 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.586 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.596 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:10.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:10.616 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:10:10.629 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-26T12:10:10.419181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.559683"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369969+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:09:50.369969+0000","last_peered":"2024-04-26T12:09:50.369969+0000","last_clean":"2024-04-26T12:09:50.369969+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:09:50.369969+0000","last_undegraded":"2024-04-26T12:09:50.369969+0000","last_fullsized":"2024-04-26T12:09:50.369969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369498+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:09:50.369498+0000","last_peered":"2024-04-26T12:09:50.369498+0000","last_clean":"2024-04-26T12:09:50.369498+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:09:50.369498+0000","last_undegraded":"2024-04-26T12:09:50.369498+0000","last_fullsized":"2024-04-26T12:09:50.369498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038574+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:09:51.038574+0000","last_peered":"2024-04-26T12:09:51.038574+0000","last_clean":"2024-04-26T12:09:51.038574+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:09:51.038574+0000","last_undegraded":"2024-04-26T12:09:51.038574+0000","last_fullsized":"2024-04-26T12:09:51.038574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038317+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:09:51.038317+0000","last_peered":"2024-04-26T12:09:51.038317+0000","last_clean":"2024-04-26T12:09:51.038317+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:09:51.038317+0000","last_undegraded":"2024-04-26T12:09:51.038317+0000","last_fullsized":"2024-04-26T12:09:51.038317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369229+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:09:50.369229+0000","last_peered":"2024-04-26T12:09:50.369229+0000","last_clean":"2024-04-26T12:09:50.369229+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:09:50.369229+0000","last_undegraded":"2024-04-26T12:09:50.369229+0000","last_fullsized":"2024-04-26T12:09:50.369229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038679+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:09:51.038679+0000","last_peered":"2024-04-26T12:09:51.038679+0000","last_clean":"2024-04-26T12:09:51.038679+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:09:51.038679+0000","last_undegraded":"2024-04-26T12:09:51.038679+0000","last_fullsized":"2024-04-26T12:09:51.038679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038135+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:09:51.038135+0000","last_peered":"2024-04-26T12:09:51.038135+0000","last_clean":"2024-04-26T12:09:51.038135+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:09:51.038135+0000","last_undegraded":"2024-04-26T12:09:51.038135+0000","last_fullsized":"2024-04-26T12:09:51.038135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037604+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:51.037604+0000","last_peered":"2024-04-26T12:09:51.037604+0000","last_clean":"2024-04-26T12:09:51.037604+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:09:51.037604+0000","last_undegraded":"2024-04-26T12:09:51.037604+0000","last_fullsized":"2024-04-26T12:09:51.037604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369193+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:09:50.369193+0000","last_peered":"2024-04-26T12:09:50.369193+0000","last_clean":"2024-04-26T12:09:50.369193+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:09:50.369193+0000","last_undegraded":"2024-04-26T12:09:50.369193+0000","last_fullsized":"2024-04-26T12:09:50.369193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369658+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:09:50.369658+0000","last_peered":"2024-04-26T12:09:50.369658+0000","last_clean":"2024-04-26T12:09:50.369658+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:09:50.369658+0000","last_undegraded":"2024-04-26T12:09:50.369658+0000","last_fullsized":"2024-04-26T12:09:50.369658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038712+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:09:51.038712+0000","last_peered":"2024-04-26T12:09:51.038712+0000","last_clean":"2024-04-26T12:09:51.038712+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:09:51.038712+0000","last_undegraded":"2024-04-26T12:09:51.038712+0000","last_fullsized":"2024-04-26T12:09:51.038712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369264+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:09:50.369264+0000","last_peered":"2024-04-26T12:09:50.369264+0000","last_clean":"2024-04-26T12:09:50.369264+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:09:50.369264+0000","last_undegraded":"2024-04-26T12:09:50.369264+0000","last_fullsized":"2024-04-26T12:09:50.369264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369028+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:09:50.369028+0000","last_peered":"2024-04-26T12:09:50.369028+0000","last_clean":"2024-04-26T12:09:50.369028+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:09:50.369028+0000","last_undegraded":"2024-04-26T12:09:50.369028+0000","last_fullsized":"2024-04-26T12:09:50.369028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038490+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:09:51.038490+0000","last_peered":"2024-04-26T12:09:51.038490+0000","last_clean":"2024-04-26T12:09:51.038490+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:09:51.038490+0000","last_undegraded":"2024-04-26T12:09:51.038490+0000","last_fullsized":"2024-04-26T12:09:51.038490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037883+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:09:51.037883+0000","last_peered":"2024-04-26T12:09:51.037883+0000","last_clean":"2024-04-26T12:09:51.037883+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:09:51.037883+0000","last_undegraded":"2024-04-26T12:09:51.037883+0000","last_fullsized":"2024-04-26T12:09:51.037883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038023+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:09:51.038023+0000","last_peered":"2024-04-26T12:09:51.038023+0000","last_clean":"2024-04-26T12:09:51.038023+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:09:51.038023+0000","last_undegraded":"2024-04-26T12:09:51.038023+0000","last_fullsized":"2024-04-26T12:09:51.038023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369218+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:09:50.369218+0000","last_peered":"2024-04-26T12:09:50.369218+0000","last_clean":"2024-04-26T12:09:50.369218+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:09:50.369218+0000","last_undegraded":"2024-04-26T12:09:50.369218+0000","last_fullsized":"2024-04-26T12:09:50.369218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369616+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:09:50.369616+0000","last_peered":"2024-04-26T12:09:50.369616+0000","last_clean":"2024-04-26T12:09:50.369616+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:09:50.369616+0000","last_undegraded":"2024-04-26T12:09:50.369616+0000","last_fullsized":"2024-04-26T12:09:50.369616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369027+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:09:50.369027+0000","last_peered":"2024-04-26T12:09:50.369027+0000","last_clean":"2024-04-26T12:09:50.369027+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:09:50.369027+0000","last_undegraded":"2024-04-26T12:09:50.369027+0000","last_fullsized":"2024-04-26T12:09:50.369027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038271+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:09:51.038271+0000","last_peered":"2024-04-26T12:09:51.038271+0000","last_clean":"2024-04-26T12:09:51.038271+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:09:51.038271+0000","last_undegraded":"2024-04-26T12:09:51.038271+0000","last_fullsized":"2024-04-26T12:09:51.038271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038148+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:09:51.038148+0000","last_peered":"2024-04-26T12:09:51.038148+0000","last_clean":"2024-04-26T12:09:51.038148+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:09:51.038148+0000","last_undegraded":"2024-04-26T12:09:51.038148+0000","last_fullsized":"2024-04-26T12:09:51.038148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368958+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:09:50.368958+0000","last_peered":"2024-04-26T12:09:50.368958+0000","last_clean":"2024-04-26T12:09:50.368958+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:09:50.368958+0000","last_undegraded":"2024-04-26T12:09:50.368958+0000","last_fullsized":"2024-04-26T12:09:50.368958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368797+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:09:50.368797+0000","last_peered":"2024-04-26T12:09:50.368797+0000","last_clean":"2024-04-26T12:09:50.368797+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:09:50.368797+0000","last_undegraded":"2024-04-26T12:09:50.368797+0000","last_fullsized":"2024-04-26T12:09:50.368797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369006+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:09:50.369006+0000","last_peered":"2024-04-26T12:09:50.369006+0000","last_clean":"2024-04-26T12:09:50.369006+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:09:50.369006+0000","last_undegraded":"2024-04-26T12:09:50.369006+0000","last_fullsized":"2024-04-26T12:09:50.369006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369913+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:09:50.369913+0000","last_peered":"2024-04-26T12:09:50.369913+0000","last_clean":"2024-04-26T12:09:50.369913+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:09:50.369913+0000","last_undegraded":"2024-04-26T12:09:50.369913+0000","last_fullsized":"2024-04-26T12:09:50.369913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369047+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:09:50.369047+0000","last_peered":"2024-04-26T12:09:50.369047+0000","last_clean":"2024-04-26T12:09:50.369047+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:09:50.369047+0000","last_undegraded":"2024-04-26T12:09:50.369047+0000","last_fullsized":"2024-04-26T12:09:50.369047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038845+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:09:51.038845+0000","last_peered":"2024-04-26T12:09:51.038845+0000","last_clean":"2024-04-26T12:09:51.038845+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:09:51.038845+0000","last_undegraded":"2024-04-26T12:09:51.038845+0000","last_fullsized":"2024-04-26T12:09:51.038845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368859+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:09:50.368859+0000","last_peered":"2024-04-26T12:09:50.368859+0000","last_clean":"2024-04-26T12:09:50.368859+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:09:50.368859+0000","last_undegraded":"2024-04-26T12:09:50.368859+0000","last_fullsized":"2024-04-26T12:09:50.368859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369717+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:09:50.369717+0000","last_peered":"2024-04-26T12:09:50.369717+0000","last_clean":"2024-04-26T12:09:50.369717+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:09:50.369717+0000","last_undegraded":"2024-04-26T12:09:50.369717+0000","last_fullsized":"2024-04-26T12:09:50.369717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369255+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:09:50.369255+0000","last_peered":"2024-04-26T12:09:50.369255+0000","last_clean":"2024-04-26T12:09:50.369255+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:09:50.369255+0000","last_undegraded":"2024-04-26T12:09:50.369255+0000","last_fullsized":"2024-04-26T12:09:50.369255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368322+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:09:50.368322+0000","last_peered":"2024-04-26T12:09:50.368322+0000","last_clean":"2024-04-26T12:09:50.368322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:09:50.368322+0000","last_undegraded":"2024-04-26T12:09:50.368322+0000","last_fullsized":"2024-04-26T12:09:50.368322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369939+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:09:50.369939+0000","last_peered":"2024-04-26T12:09:50.369939+0000","last_clean":"2024-04-26T12:09:50.369939+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:09:50.369939+0000","last_undegraded":"2024-04-26T12:09:50.369939+0000","last_fullsized":"2024-04-26T12:09:50.369939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369400+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:09:50.369400+0000","last_peered":"2024-04-26T12:09:50.369400+0000","last_clean":"2024-04-26T12:09:50.369400+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:09:50.369400+0000","last_undegraded":"2024-04-26T12:09:50.369400+0000","last_fullsized":"2024-04-26T12:09:50.369400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368209+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:09:50.368209+0000","last_peered":"2024-04-26T12:09:50.368209+0000","last_clean":"2024-04-26T12:09:50.368209+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:09:50.368209+0000","last_undegraded":"2024-04-26T12:09:50.368209+0000","last_fullsized":"2024-04-26T12:09:50.368209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038783+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:09:51.038783+0000","last_peered":"2024-04-26T12:09:51.038783+0000","last_clean":"2024-04-26T12:09:51.038783+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:09:51.038783+0000","last_undegraded":"2024-04-26T12:09:51.038783+0000","last_fullsized":"2024-04-26T12:09:51.038783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368536+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:09:50.368536+0000","last_peered":"2024-04-26T12:09:50.368536+0000","last_clean":"2024-04-26T12:09:50.368536+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:09:50.368536+0000","last_undegraded":"2024-04-26T12:09:50.368536+0000","last_fullsized":"2024-04-26T12:09:50.368536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369603+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:09:50.369603+0000","last_peered":"2024-04-26T12:09:50.369603+0000","last_clean":"2024-04-26T12:09:50.369603+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:09:50.369603+0000","last_undegraded":"2024-04-26T12:09:50.369603+0000","last_fullsized":"2024-04-26T12:09:50.369603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368634+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:09:50.368634+0000","last_peered":"2024-04-26T12:09:50.368634+0000","last_clean":"2024-04-26T12:09:50.368634+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:09:50.368634+0000","last_undegraded":"2024-04-26T12:09:50.368634+0000","last_fullsized":"2024-04-26T12:09:50.368634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038379+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:09:51.038379+0000","last_peered":"2024-04-26T12:09:51.038379+0000","last_clean":"2024-04-26T12:09:51.038379+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:09:51.038379+0000","last_undegraded":"2024-04-26T12:09:51.038379+0000","last_fullsized":"2024-04-26T12:09:51.038379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038369+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:09:51.038369+0000","last_peered":"2024-04-26T12:09:51.038369+0000","last_clean":"2024-04-26T12:09:51.038369+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:09:51.038369+0000","last_undegraded":"2024-04-26T12:09:51.038369+0000","last_fullsized":"2024-04-26T12:09:51.038369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038264+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:09:51.038264+0000","last_peered":"2024-04-26T12:09:51.038264+0000","last_clean":"2024-04-26T12:09:51.038264+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:09:51.038264+0000","last_undegraded":"2024-04-26T12:09:51.038264+0000","last_fullsized":"2024-04-26T12:09:51.038264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369313+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:09:50.369313+0000","last_peered":"2024-04-26T12:09:50.369313+0000","last_clean":"2024-04-26T12:09:50.369313+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:09:50.369313+0000","last_undegraded":"2024-04-26T12:09:50.369313+0000","last_fullsized":"2024-04-26T12:09:50.369313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368527+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:09:50.368527+0000","last_peered":"2024-04-26T12:09:50.368527+0000","last_clean":"2024-04-26T12:09:50.368527+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:09:50.368527+0000","last_undegraded":"2024-04-26T12:09:50.368527+0000","last_fullsized":"2024-04-26T12:09:50.368527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369789+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:09:50.369789+0000","last_peered":"2024-04-26T12:09:50.369789+0000","last_clean":"2024-04-26T12:09:50.369789+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:09:50.369789+0000","last_undegraded":"2024-04-26T12:09:50.369789+0000","last_fullsized":"2024-04-26T12:09:50.369789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368872+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:09:50.368872+0000","last_peered":"2024-04-26T12:09:50.368872+0000","last_clean":"2024-04-26T12:09:50.368872+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:09:50.368872+0000","last_undegraded":"2024-04-26T12:09:50.368872+0000","last_fullsized":"2024-04-26T12:09:50.368872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369330+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:09:50.369330+0000","last_peered":"2024-04-26T12:09:50.369330+0000","last_clean":"2024-04-26T12:09:50.369330+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:09:50.369330+0000","last_undegraded":"2024-04-26T12:09:50.369330+0000","last_fullsized":"2024-04-26T12:09:50.369330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037731+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:09:51.037731+0000","last_peered":"2024-04-26T12:09:51.037731+0000","last_clean":"2024-04-26T12:09:51.037731+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:09:51.037731+0000","last_undegraded":"2024-04-26T12:09:51.037731+0000","last_fullsized":"2024-04-26T12:09:51.037731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038797+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:09:51.038797+0000","last_peered":"2024-04-26T12:09:51.038797+0000","last_clean":"2024-04-26T12:09:51.038797+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:09:51.038797+0000","last_undegraded":"2024-04-26T12:09:51.038797+0000","last_fullsized":"2024-04-26T12:09:51.038797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368594+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:09:50.368594+0000","last_peered":"2024-04-26T12:09:50.368594+0000","last_clean":"2024-04-26T12:09:50.368594+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:09:50.368594+0000","last_undegraded":"2024-04-26T12:09:50.368594+0000","last_fullsized":"2024-04-26T12:09:50.368594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369426+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:09:50.369426+0000","last_peered":"2024-04-26T12:09:50.369426+0000","last_clean":"2024-04-26T12:09:50.369426+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:09:50.369426+0000","last_undegraded":"2024-04-26T12:09:50.369426+0000","last_fullsized":"2024-04-26T12:09:50.369426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369064+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:09:50.369064+0000","last_peered":"2024-04-26T12:09:50.369064+0000","last_clean":"2024-04-26T12:09:50.369064+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:09:50.369064+0000","last_undegraded":"2024-04-26T12:09:50.369064+0000","last_fullsized":"2024-04-26T12:09:50.369064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038575+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:09:51.038575+0000","last_peered":"2024-04-26T12:09:51.038575+0000","last_clean":"2024-04-26T12:09:51.038575+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:09:51.038575+0000","last_undegraded":"2024-04-26T12:09:51.038575+0000","last_fullsized":"2024-04-26T12:09:51.038575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038274+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:09:51.038274+0000","last_peered":"2024-04-26T12:09:51.038274+0000","last_clean":"2024-04-26T12:09:51.038274+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:09:51.038274+0000","last_undegraded":"2024-04-26T12:09:51.038274+0000","last_fullsized":"2024-04-26T12:09:51.038274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037931+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:09:51.037931+0000","last_peered":"2024-04-26T12:09:51.037931+0000","last_clean":"2024-04-26T12:09:51.037931+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:09:51.037931+0000","last_undegraded":"2024-04-26T12:09:51.037931+0000","last_fullsized":"2024-04-26T12:09:51.037931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368871+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:09:50.368871+0000","last_peered":"2024-04-26T12:09:50.368871+0000","last_clean":"2024-04-26T12:09:50.368871+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:09:50.368871+0000","last_undegraded":"2024-04-26T12:09:50.368871+0000","last_fullsized":"2024-04-26T12:09:50.368871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368652+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:09:50.368652+0000","last_peered":"2024-04-26T12:09:50.368652+0000","last_clean":"2024-04-26T12:09:50.368652+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:09:50.368652+0000","last_undegraded":"2024-04-26T12:09:50.368652+0000","last_fullsized":"2024-04-26T12:09:50.368652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038004+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:09:51.038004+0000","last_peered":"2024-04-26T12:09:51.038004+0000","last_clean":"2024-04-26T12:09:51.038004+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:09:51.038004+0000","last_undegraded":"2024-04-26T12:09:51.038004+0000","last_fullsized":"2024-04-26T12:09:51.038004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037940+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:09:51.037940+0000","last_peered":"2024-04-26T12:09:51.037940+0000","last_clean":"2024-04-26T12:09:51.037940+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:09:51.037940+0000","last_undegraded":"2024-04-26T12:09:51.037940+0000","last_fullsized":"2024-04-26T12:09:51.037940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038840+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:09:51.038840+0000","last_peered":"2024-04-26T12:09:51.038840+0000","last_clean":"2024-04-26T12:09:51.038840+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:09:51.038840+0000","last_undegraded":"2024-04-26T12:09:51.038840+0000","last_fullsized":"2024-04-26T12:09:51.038840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038861+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:09:51.038861+0000","last_peered":"2024-04-26T12:09:51.038861+0000","last_clean":"2024-04-26T12:09:51.038861+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:09:51.038861+0000","last_undegraded":"2024-04-26T12:09:51.038861+0000","last_fullsized":"2024-04-26T12:09:51.038861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368764+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:09:50.368764+0000","last_peered":"2024-04-26T12:09:50.368764+0000","last_clean":"2024-04-26T12:09:50.368764+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:09:50.368764+0000","last_undegraded":"2024-04-26T12:09:50.368764+0000","last_fullsized":"2024-04-26T12:09:50.368764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369310+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:09:50.369310+0000","last_peered":"2024-04-26T12:09:50.369310+0000","last_clean":"2024-04-26T12:09:50.369310+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:09:50.369310+0000","last_undegraded":"2024-04-26T12:09:50.369310+0000","last_fullsized":"2024-04-26T12:09:50.369310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369295+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:09:50.369295+0000","last_peered":"2024-04-26T12:09:50.369295+0000","last_clean":"2024-04-26T12:09:50.369295+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:09:50.369295+0000","last_undegraded":"2024-04-26T12:09:50.369295+0000","last_fullsized":"2024-04-26T12:09:50.369295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366167+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:09:49.366167+0000","last_peered":"2024-04-26T12:09:49.366167+0000","last_clean":"2024-04-26T12:09:49.366167+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:09:49.366167+0000","last_undegraded":"2024-04-26T12:09:49.366167+0000","last_fullsized":"2024-04-26T12:09:49.366167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368268+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:09:50.368268+0000","last_peered":"2024-04-26T12:09:50.368268+0000","last_clean":"2024-04-26T12:09:50.368268+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:09:50.368268+0000","last_undegraded":"2024-04-26T12:09:50.368268+0000","last_fullsized":"2024-04-26T12:09:50.368268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365795+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:09:49.365795+0000","last_peered":"2024-04-26T12:09:49.365795+0000","last_clean":"2024-04-26T12:09:49.365795+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:09:49.365795+0000","last_undegraded":"2024-04-26T12:09:49.365795+0000","last_fullsized":"2024-04-26T12:09:49.365795+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.865635+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:09:51.865635+0000","last_peered":"2024-04-26T12:09:51.865635+0000","last_clean":"2024-04-26T12:09:51.865635+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:09:51.865635+0000","last_undegraded":"2024-04-26T12:09:51.865635+0000","last_fullsized":"2024-04-26T12:09:51.865635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368886+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:09:50.368886+0000","last_peered":"2024-04-26T12:09:50.368886+0000","last_clean":"2024-04-26T12:09:50.368886+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:09:50.368886+0000","last_undegraded":"2024-04-26T12:09:50.368886+0000","last_fullsized":"2024-04-26T12:09:50.368886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.371582+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:09:49.371582+0000","last_peered":"2024-04-26T12:09:49.371582+0000","last_clean":"2024-04-26T12:09:49.371582+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:09:49.371582+0000","last_undegraded":"2024-04-26T12:09:49.371582+0000","last_fullsized":"2024-04-26T12:09:49.371582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.363531+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:09:49.363531+0000","last_peered":"2024-04-26T12:09:49.363531+0000","last_clean":"2024-04-26T12:09:49.363531+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:09:49.363531+0000","last_undegraded":"2024-04-26T12:09:49.363531+0000","last_fullsized":"2024-04-26T12:09:49.363531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368309+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:09:50.368309+0000","last_peered":"2024-04-26T12:09:50.368309+0000","last_clean":"2024-04-26T12:09:50.368309+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:09:50.368309+0000","last_undegraded":"2024-04-26T12:09:50.368309+0000","last_fullsized":"2024-04-26T12:09:50.368309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369739+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:09:50.369739+0000","last_peered":"2024-04-26T12:09:50.369739+0000","last_clean":"2024-04-26T12:09:50.369739+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:09:50.369739+0000","last_undegraded":"2024-04-26T12:09:50.369739+0000","last_fullsized":"2024-04-26T12:09:50.369739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.364512+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:09:49.364512+0000","last_peered":"2024-04-26T12:09:49.364512+0000","last_clean":"2024-04-26T12:09:49.364512+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:09:49.364512+0000","last_undegraded":"2024-04-26T12:09:49.364512+0000","last_fullsized":"2024-04-26T12:09:49.364512+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368726+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:09:50.368726+0000","last_peered":"2024-04-26T12:09:50.368726+0000","last_clean":"2024-04-26T12:09:50.368726+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:09:50.368726+0000","last_undegraded":"2024-04-26T12:09:50.368726+0000","last_fullsized":"2024-04-26T12:09:50.368726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369499+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:09:50.369499+0000","last_peered":"2024-04-26T12:09:50.369499+0000","last_clean":"2024-04-26T12:09:50.369499+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:09:50.369499+0000","last_undegraded":"2024-04-26T12:09:50.369499+0000","last_fullsized":"2024-04-26T12:09:50.369499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365007+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:09:49.365007+0000","last_peered":"2024-04-26T12:09:49.365007+0000","last_clean":"2024-04-26T12:09:49.365007+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:09:49.365007+0000","last_undegraded":"2024-04-26T12:09:49.365007+0000","last_fullsized":"2024-04-26T12:09:49.365007+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368492+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:09:50.368492+0000","last_peered":"2024-04-26T12:09:50.368492+0000","last_clean":"2024-04-26T12:09:50.368492+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:09:50.368492+0000","last_undegraded":"2024-04-26T12:09:50.368492+0000","last_fullsized":"2024-04-26T12:09:50.368492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038714+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:09:51.038714+0000","last_peered":"2024-04-26T12:09:51.038714+0000","last_clean":"2024-04-26T12:09:51.038714+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:09:51.038714+0000","last_undegraded":"2024-04-26T12:09:51.038714+0000","last_fullsized":"2024-04-26T12:09:51.038714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.367907+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:09:49.367907+0000","last_peered":"2024-04-26T12:09:49.367907+0000","last_clean":"2024-04-26T12:09:49.367907+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:09:49.367907+0000","last_undegraded":"2024-04-26T12:09:49.367907+0000","last_fullsized":"2024-04-26T12:09:49.367907+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038397+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:09:51.038397+0000","last_peered":"2024-04-26T12:09:51.038397+0000","last_clean":"2024-04-26T12:09:51.038397+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:09:51.038397+0000","last_undegraded":"2024-04-26T12:09:51.038397+0000","last_fullsized":"2024-04-26T12:09:51.038397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368895+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:09:50.368895+0000","last_peered":"2024-04-26T12:09:50.368895+0000","last_clean":"2024-04-26T12:09:50.368895+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:09:50.368895+0000","last_undegraded":"2024-04-26T12:09:50.368895+0000","last_fullsized":"2024-04-26T12:09:50.368895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.366938+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:09:49.366938+0000","last_peered":"2024-04-26T12:09:49.366938+0000","last_clean":"2024-04-26T12:09:49.366938+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:09:49.366938+0000","last_undegraded":"2024-04-26T12:09:49.366938+0000","last_fullsized":"2024-04-26T12:09:49.366938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369020+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:09:50.369020+0000","last_peered":"2024-04-26T12:09:50.369020+0000","last_clean":"2024-04-26T12:09:50.369020+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:09:50.369020+0000","last_undegraded":"2024-04-26T12:09:50.369020+0000","last_fullsized":"2024-04-26T12:09:50.369020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369286+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:09:50.369286+0000","last_peered":"2024-04-26T12:09:50.369286+0000","last_clean":"2024-04-26T12:09:50.369286+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:09:50.369286+0000","last_undegraded":"2024-04-26T12:09:50.369286+0000","last_fullsized":"2024-04-26T12:09:50.369286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:10:10.413205+0000","last_change":"2024-04-26T12:10:10.413205+0000","last_active":"2024-04-26T12:10:10.413205+0000","last_peered":"2024-04-26T12:10:10.413205+0000","last_clean":"2024-04-26T12:10:10.413205+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:10:10.413205+0000","last_undegraded":"2024-04-26T12:10:10.413205+0000","last_fullsized":"2024-04-26T12:10:10.413205+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:09:49.365338+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:09:49.365338+0000","last_peered":"2024-04-26T12:09:49.365338+0000","last_clean":"2024-04-26T12:09:49.365338+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:09:49.365338+0000","last_undegraded":"2024-04-26T12:09:49.365338+0000","last_fullsized":"2024-04-26T12:09:49.365338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038455+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:09:51.038455+0000","last_peered":"2024-04-26T12:09:51.038455+0000","last_clean":"2024-04-26T12:09:51.038455+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:09:51.038455+0000","last_undegraded":"2024-04-26T12:09:51.038455+0000","last_fullsized":"2024-04-26T12:09:51.038455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369141+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:09:50.369141+0000","last_peered":"2024-04-26T12:09:50.369141+0000","last_clean":"2024-04-26T12:09:50.369141+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:09:50.369141+0000","last_undegraded":"2024-04-26T12:09:50.369141+0000","last_fullsized":"2024-04-26T12:09:50.369141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369156+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:09:50.369156+0000","last_peered":"2024-04-26T12:09:50.369156+0000","last_clean":"2024-04-26T12:09:50.369156+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:09:50.369156+0000","last_undegraded":"2024-04-26T12:09:50.369156+0000","last_fullsized":"2024-04-26T12:09:50.369156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369526+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:09:50.369526+0000","last_peered":"2024-04-26T12:09:50.369526+0000","last_clean":"2024-04-26T12:09:50.369526+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:09:50.369526+0000","last_undegraded":"2024-04-26T12:09:50.369526+0000","last_fullsized":"2024-04-26T12:09:50.369526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038564+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:09:51.038564+0000","last_peered":"2024-04-26T12:09:51.038564+0000","last_clean":"2024-04-26T12:09:51.038564+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:09:51.038564+0000","last_undegraded":"2024-04-26T12:09:51.038564+0000","last_fullsized":"2024-04-26T12:09:51.038564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038547+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:09:51.038547+0000","last_peered":"2024-04-26T12:09:51.038547+0000","last_clean":"2024-04-26T12:09:51.038547+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:09:51.038547+0000","last_undegraded":"2024-04-26T12:09:51.038547+0000","last_fullsized":"2024-04-26T12:09:51.038547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369765+0000","last_change":"2024-04-26T12:09:48.933741+0000","last_active":"2024-04-26T12:09:50.369765+0000","last_peered":"2024-04-26T12:09:50.369765+0000","last_clean":"2024-04-26T12:09:50.369765+0000","last_became_active":"2024-04-26T12:09:48.933421+0000","last_became_peered":"2024-04-26T12:09:48.933421+0000","last_unstale":"2024-04-26T12:09:50.369765+0000","last_undegraded":"2024-04-26T12:09:50.369765+0000","last_fullsized":"2024-04-26T12:09:50.369765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.038069+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:09:51.038069+0000","last_peered":"2024-04-26T12:09:51.038069+0000","last_clean":"2024-04-26T12:09:51.038069+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:09:51.038069+0000","last_undegraded":"2024-04-26T12:09:51.038069+0000","last_fullsized":"2024-04-26T12:09:51.038069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369160+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:09:50.369160+0000","last_peered":"2024-04-26T12:09:50.369160+0000","last_clean":"2024-04-26T12:09:50.369160+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:09:50.369160+0000","last_undegraded":"2024-04-26T12:09:50.369160+0000","last_fullsized":"2024-04-26T12:09:50.369160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369111+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:09:50.369111+0000","last_peered":"2024-04-26T12:09:50.369111+0000","last_clean":"2024-04-26T12:09:50.369111+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:09:50.369111+0000","last_undegraded":"2024-04-26T12:09:50.369111+0000","last_fullsized":"2024-04-26T12:09:50.369111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369401+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:09:50.369401+0000","last_peered":"2024-04-26T12:09:50.369401+0000","last_clean":"2024-04-26T12:09:50.369401+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:09:50.369401+0000","last_undegraded":"2024-04-26T12:09:50.369401+0000","last_fullsized":"2024-04-26T12:09:50.369401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037891+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:09:51.037891+0000","last_peered":"2024-04-26T12:09:51.037891+0000","last_clean":"2024-04-26T12:09:51.037891+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:09:51.037891+0000","last_undegraded":"2024-04-26T12:09:51.037891+0000","last_fullsized":"2024-04-26T12:09:51.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:51.037736+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:09:51.037736+0000","last_peered":"2024-04-26T12:09:51.037736+0000","last_clean":"2024-04-26T12:09:51.037736+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:09:51.037736+0000","last_undegraded":"2024-04-26T12:09:51.037736+0000","last_fullsized":"2024-04-26T12:09:51.037736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.368341+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:09:50.368341+0000","last_peered":"2024-04-26T12:09:50.368341+0000","last_clean":"2024-04-26T12:09:50.368341+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:09:50.368341+0000","last_undegraded":"2024-04-26T12:09:50.368341+0000","last_fullsized":"2024-04-26T12:09:50.368341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369136+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:09:50.369136+0000","last_peered":"2024-04-26T12:09:50.369136+0000","last_clean":"2024-04-26T12:09:50.369136+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:09:50.369136+0000","last_undegraded":"2024-04-26T12:09:50.369136+0000","last_fullsized":"2024-04-26T12:09:50.369136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369107+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:09:50.369107+0000","last_peered":"2024-04-26T12:09:50.369107+0000","last_clean":"2024-04-26T12:09:50.369107+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:09:50.369107+0000","last_undegraded":"2024-04-26T12:09:50.369107+0000","last_fullsized":"2024-04-26T12:09:50.369107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:09:50.369557+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:09:50.369557+0000","last_peered":"2024-04-26T12:09:50.369557+0000","last_clean":"2024-04-26T12:09:50.369557+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:09:50.369557+0000","last_undegraded":"2024-04-26T12:09:50.369557+0000","last_fullsized":"2024-04-26T12:09:50.369557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:10.634 INFO:tasks.thrashosds.thrasher:Setting 3.1d to [0, 1] 2024-04-26T12:10:10.634 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1d', '0', '1'] 2024-04-26T12:10:10.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1d 0 1 2024-04-26T12:10:10.643 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:10.642+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:10.740 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.741 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.744 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:10.743+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:10.751 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:10.844 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:10.843+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:10.920 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:10.921 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:10.931 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:10.946 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:10.945+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:11.046 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:11.045+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:11.099 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.099 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:11.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:11.153 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:11.152+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:11.249 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:11.248+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:11.249 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.249 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:11.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:11.349 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:11.348+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:11.427 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.427 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:set 3.1d pg_upmap mapping to [0,1] 2024-04-26T12:10:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-26T12:10:11.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:11.482 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:11.481+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:11.553 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:11.550+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:11.566 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.566 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:11.576 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:11.652 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:11.652+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:11.717 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.717 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:11.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:11.753 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:11.752+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:11.854 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.854 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:11.854 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:11.853+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:11.865 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:11.955 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:11.955+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:11.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:11.992 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:11.992 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:12.002 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:12.056 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:12.055+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:12.139 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:12.139 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:12.150 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:12.150 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:12.156 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:12.155+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:12.171 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:12.191 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:12.257 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:12.257+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:12.278 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:12.278 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:12.278 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:12.278 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:12.279 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:12.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:12.358 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:12.357+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:12.417 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:12.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.048883959000001, 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016256112, 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:12.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365793+0000", 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999952 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365806+0000", 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3039e-05 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365819+0000", 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3132000000000001e-05 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365834+0000", 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365953+0000", 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011895700000000001 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375316+0000", 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093566369999999992 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375394+0000", 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7732999999999996e-05 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375472+0000", 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8182999999999993e-05 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381062+0000", 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055902030000000002 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381964+0000", 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090143000000000005 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382012+0000", 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8192999999999998e-05 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382054+0000", 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1936e-05 2024-04-26T12:10:12.446 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.048822373, 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016298395, 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365858+0000", 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365864+0000", 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365873+0000", 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365882+0000", 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4989999999999994e-06 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366075+0000", 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019275499999999999 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366080+0000", 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375717+0000", 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096367499999999995 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375784+0000", 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6649000000000005e-05 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375898+0000", 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011433 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381103+0000", 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052053610000000004 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382076+0000", 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097246799999999999 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382121+0000", 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5714999999999999e-05 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382158+0000", 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6174999999999998e-05 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.048794204, 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.458 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.048721866000001, 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:12.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:12.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:12.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.464 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.048691331000001, 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016265910000000001, 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365994+0000", 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:10:12.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366006+0000", 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1816e-05 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366011+0000", 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368181+0000", 2024-04-26T12:10:12.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021698279999999999 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368185+0000", 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4900000000000002e-06 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376058+0000", 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078721069999999997 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376139+0000", 2024-04-26T12:10:12.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0958000000000007e-05 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376224+0000", 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5680000000000006e-05 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381953+0000", 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057284379999999998 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382171+0000", 2024-04-26T12:10:12.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021846100000000001 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382221+0000", 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9869e-05 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382256+0000", 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5182999999999998e-05 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.048455164, 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01469869, 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366232+0000", 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1530000000000002e-06 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366243+0000", 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1103e-05 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366260+0000", 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022716699999999999 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.473 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368538+0000", 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9270000000000002e-06 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373128+0000", 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045899799999999996 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373834+0000", 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00070583699999999996 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.474 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374269+0000", 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00043562499999999998 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380083+0000", 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0058130949999999999 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380821+0000", 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00073799399999999995 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380880+0000", 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9001e-05 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380925+0000", 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5617e-05 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:12.476 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.047073352000002, 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01400622, 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367605+0000", 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999967 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367613+0000", 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5059999999999995e-06 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367625+0000", 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2114e-05 2024-04-26T12:10:12.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367637+0000", 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1739999999999999e-05 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369337+0000", 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001699519 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369342+0000", 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374717+0000", 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053750869999999997 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375164+0000", 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00044635699999999998 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381614+0000", 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0064507310000000003 2024-04-26T12:10:12.480 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.047036222999999, 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015300935, 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:12.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367648+0000", 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.659e-06 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367657+0000", 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367667+0000", 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368391+0000", 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072424000000000002 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368397+0000", 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6389999999999997e-06 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377728+0000", 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093318099999999994 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377867+0000", 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013898 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382946+0000", 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050788350000000003 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:12.485 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.368201+0000", 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.046480242000001, 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013449111999999999, 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368201+0000", 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368201+0000", 2024-04-26T12:10:12.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368200+0000", 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368214+0000", 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3183999999999999e-05 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368225+0000", 2024-04-26T12:10:12.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1449e-05 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368234+0000", 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3190000000000001e-06 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368303+0000", 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8448000000000006e-05 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:12.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368310+0000", 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375247+0000", 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0069367689999999997 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375367+0000", 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120376 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381650+0000", 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062832169999999998 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.369512+0000", 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.045169770000001, 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004495041, 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369512+0000", 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369512+0000", 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369512+0000", 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369520+0000", 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9500000000000007e-06 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369532+0000", 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2017e-05 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369542+0000", 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5060000000000001e-06 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369621+0000", 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9172999999999996e-05 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374007+0000", 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043857139999999998 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(mds.0.3:28 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.370382+0000", 2024-04-26T12:10:12.493 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.044299410000001, 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078137239999999993, 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370382+0000", 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370382+0000", 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370382+0000", 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370412+0000", 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0130000000000001e-05 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370420+0000", 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7079999999999997e-06 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370427+0000", 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370496+0000", 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8607000000000002e-05 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.370517+0000", 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1219000000000001e-05 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378157+0000", 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076394200000000001 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378196+0000", 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9165999999999997e-05 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(mds.0.3:27 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:10:12.497 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.373924+0000", 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.040757876000001, 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0077207819999999998, 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373924+0000", 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373924+0000", 2024-04-26T12:10:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373923+0000", 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373943+0000", 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0166e-05 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373951+0000", 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9149999999999996e-06 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373960+0000", 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2879999999999998e-06 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374603+0000", 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00064283299999999999 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374625+0000", 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1322e-05 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381619+0000", 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0069944860000000003 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381645+0000", 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5474999999999999e-05 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(mds.0.3:20 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.378390+0000", 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.036291407, 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038073019999999998, 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378390+0000", 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378390+0000", 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378390+0000", 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378407+0000", 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7431e-05 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378415+0000", 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2790000000000001e-06 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378423+0000", 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1110000000000008e-06 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378572+0000", 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149197 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378852+0000", 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00027990300000000002 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382159+0000", 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00330715 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382197+0000", 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8614e-05 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.505 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(mds.0.3:21 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.378435+0000", 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.036246237, 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039885679999999996, 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378435+0000", 2024-04-26T12:10:12.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378435+0000", 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378435+0000", 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378440+0000", 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8189999999999999e-06 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378447+0000", 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8399999999999997e-06 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378462+0000", 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5671e-05 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.379274+0000", 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081161199999999997 2024-04-26T12:10:12.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.379400+0000", 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012602499999999999 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382364+0000", 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029639129999999999 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382424+0000", 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0096999999999997e-05 2024-04-26T12:10:12.509 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e15/13 ondisk, result = 0)", 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.380218+0000", 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.034463903999999, 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00071442900000000004, 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380218+0000", 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380218+0000", 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380217+0000", 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380221+0000", 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.941e-06 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380229+0000", 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5859999999999999e-06 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380249+0000", 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0851000000000001e-05 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380804+0000", 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00055498799999999997 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380814+0000", 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380932+0000", 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000117674 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.513 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 1 lcod 15'2)", 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.380511+0000", 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.034170972999998, 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00054399500000000003, 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380511+0000", 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380511+0000", 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380510+0000", 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380513+0000", 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2760000000000001e-06 2024-04-26T12:10:12.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380793+0000", 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00027929099999999998 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380803+0000", 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9650000000000003e-06 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381040+0000", 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000237727 2024-04-26T12:10:12.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381055+0000", 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4178999999999999e-05 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.381525+0000", 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.033156522999999, 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00073535600000000005, 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.517 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381525+0000", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381525+0000", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381524+0000", 2024-04-26T12:10:12.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381529+0000", 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4499999999999997e-06 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381537+0000", 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1529999999999997e-06 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381556+0000", 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9411000000000001e-05 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381719+0000", 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000162759 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381944+0000", 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00022487000000000001 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382260+0000", 2024-04-26T12:10:12.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00031634700000000003 2024-04-26T12:10:12.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.521 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 6 lcod 15'4)", 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.381574+0000", 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.033108050999999, 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00076384599999999999, 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381574+0000", 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381574+0000", 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381573+0000", 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381576+0000", 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3589999999999999e-06 2024-04-26T12:10:12.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381640+0000", 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4033000000000002e-05 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381650+0000", 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1190000000000003e-06 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382323+0000", 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00067311400000000005 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382337+0000", 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4769999999999999e-05 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.381575+0000", 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.033106341, 2024-04-26T12:10:12.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00040221499999999998, 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381575+0000", 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381575+0000", 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381574+0000", 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381580+0000", 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381588+0000", 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5799999999999992e-06 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381606+0000", 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8153999999999999e-05 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381958+0000", 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00035197199999999998 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381966+0000", 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7589999999999997e-06 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381977+0000", 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1365999999999999e-05 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:54.021248+0000", 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.393433221999999, 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0017669109999999999, 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:12.529 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021248+0000", 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021248+0000", 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021246+0000", 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999976 2024-04-26T12:10:12.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021260+0000", 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3409e-05 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021291+0000", 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1380000000000001e-05 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021308+0000", 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7255999999999999e-05 2024-04-26T12:10:12.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021419+0000", 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021589+0000", 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017021699999999999 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.021706+0000", 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011702200000000001 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.022303+0000", 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00059720599999999997 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.022950+0000", 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00064706400000000004 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.022987+0000", 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7290999999999999e-05 2024-04-26T12:10:12.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:54.023015+0000", 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7892999999999999e-05 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:12.534 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:12.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:10:12.535 DEBUG:teuthology.orchestra.run.smithi045:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-26T12:10:12.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:12.537 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:12.535+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:12.539 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-26T12:10:12.549 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-26T12:10:12.549 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-26T12:10:12.601 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-26T12:10:12.602 DEBUG:teuthology.orchestra.run.smithi045:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T12:10:12.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:hints = 1 2024-04-26T12:10:12.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-26T12:10:12.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Object prefix: benchmark_data_smithi045_43640 2024-04-26T12:10:12.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T12:10:12.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 0 0 0 0 0 0 - 0 2024-04-26T12:10:12.637 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:12.636+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:12.709 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:12.709 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:12.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.709 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:438 5.2 5:40bfd2d1:::benchmark_data_smithi045_43640_object437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.707571+0000", 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00084151699999999996, 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086695399999999997, 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 438 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707571+0000", 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707571+0000", 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707571+0000", 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707642+0000", 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0815999999999994e-05 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707649+0000", 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8059999999999995e-06 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707654+0000", 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9620000000000001e-06 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707682+0000", 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7929999999999999e-05 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707749+0000", 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6427000000000006e-05 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707827+0000", 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7830000000000005e-05 2024-04-26T12:10:12.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:436 5.c e19/17 5:30a8105f:::benchmark_data_smithi045_43640_object435:head v 19'27, mlcod=19'23)", 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.707989+0000", 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00042386799999999999, 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049800400000000002, 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707989+0000", 2024-04-26T12:10:12.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707989+0000", 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707989+0000", 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708084+0000", 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5650999999999996e-05 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708095+0000", 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0832999999999999e-05 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708099+0000", 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708125+0000", 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5100999999999999e-05 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708138+0000", 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3492999999999999e-05 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:440 5.5 e19/17 5:a3c77239:::benchmark_data_smithi045_43640_object439:head v 19'24, mlcod=19'21)", 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.708199+0000", 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00021381800000000001, 2024-04-26T12:10:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032245599999999999, 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708199+0000", 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708199+0000", 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708199+0000", 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708269+0000", 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0340999999999996e-05 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708278+0000", 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5650000000000002e-06 2024-04-26T12:10:12.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708284+0000", 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2979999999999997e-06 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708318+0000", 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4110999999999999e-05 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.708337+0000", 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9459000000000001e-05 2024-04-26T12:10:12.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:424 5.5 e19/17 5:a362e2ab:::benchmark_data_smithi045_43640_object423:head v 19'23, mlcod=19'21)", 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.704751+0000", 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0036617709999999999, 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00381314, 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704751+0000", 2024-04-26T12:10:12.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704751+0000", 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704751+0000", 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704811+0000", 2024-04-26T12:10:12.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9787999999999997e-05 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704815+0000", 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704820+0000", 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704851+0000", 2024-04-26T12:10:12.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1189000000000002e-05 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.704869+0000", 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7975e-05 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:428 5.1 5:86e1c4fb:::benchmark_data_smithi045_43640_object427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.706299+0000", 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0021138659999999998, 2024-04-26T12:10:12.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002302489, 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 428 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706299+0000", 2024-04-26T12:10:12.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706299+0000", 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706298+0000", 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706383+0000", 2024-04-26T12:10:12.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5169999999999999e-05 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706394+0000", 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.076e-05 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706408+0000", 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3963e-05 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706445+0000", 2024-04-26T12:10:12.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514000000000003e-05 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706568+0000", 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012333999999999999 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706711+0000", 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014333799999999999 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:432 5.f 5:fa4652f6:::benchmark_data_smithi045_43640_object431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.706603+0000", 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0018102249999999999, 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00204177, 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 432 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706603+0000", 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706603+0000", 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706602+0000", 2024-04-26T12:10:12.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706713+0000", 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0001108 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706721+0000", 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0050000000000004e-06 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706725+0000", 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1910000000000002e-06 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706759+0000", 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4508999999999998e-05 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706869+0000", 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109207 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706990+0000", 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012139 2024-04-26T12:10:12.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707921+0000", 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093102300000000001 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:433 5.1 5:854d4de8:::benchmark_data_smithi045_43640_object432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.706733+0000", 2024-04-26T12:10:12.734 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0016800630000000001, 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019560789999999999, 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 433 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706733+0000", 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706733+0000", 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706732+0000", 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706780+0000", 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8094999999999999e-05 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706793+0000", 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2386e-05 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706800+0000", 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.024e-06 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707197+0000", 2024-04-26T12:10:12.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00039729400000000002 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707305+0000", 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107749 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707427+0000", 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012238799999999999 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:430 5.3 e19/17 5:c304b67c:::benchmark_data_smithi045_43640_object429:head v 19'33, mlcod=19'31)", 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.706796+0000", 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.001617027, 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019341829999999999, 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706796+0000", 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706796+0000", 2024-04-26T12:10:12.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706795+0000", 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706865+0000", 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.957e-05 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706874+0000", 2024-04-26T12:10:12.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0790000000000007e-06 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706880+0000", 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2899999999999999e-06 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706913+0000", 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2471999999999997e-05 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706930+0000", 2024-04-26T12:10:12.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7706999999999998e-05 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:431 5.c e19/17 5:386dff2e:::benchmark_data_smithi045_43640_object430:head v 19'25, mlcod=19'22)", 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.706995+0000", 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0014180760000000001, 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001767509, 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706995+0000", 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706995+0000", 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.706994+0000", 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707059+0000", 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4318000000000003e-05 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707067+0000", 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707071+0000", 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707100+0000", 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8639000000000001e-05 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707121+0000", 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.124e-05 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:435 5.c e19/17 5:3abc7e6e:::benchmark_data_smithi045_43640_object434:head v 19'26, mlcod=19'22)", 2024-04-26T12:10:12.747 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:12.707376+0000", 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.001037435, 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001419858, 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707376+0000", 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707376+0000", 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707375+0000", 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707466+0000", 2024-04-26T12:10:12.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1006000000000002e-05 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707472+0000", 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1070000000000001e-06 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707477+0000", 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707505+0000", 2024-04-26T12:10:12.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7546e-05 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:12.707523+0000", 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8312e-05 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 10 2024-04-26T12:10:12.751 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:12.752 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:12.751+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:12.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:12.853 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:12.852+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:12.954 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:12.953+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:12.965 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:12.965 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:12.965 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-26T12:10:12.965 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-26T12:10:12.965 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:12.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:13.055 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:13.054+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:13.156 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:13.155+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:13.172 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:161 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.796308045, 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012629592, 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:13.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 161 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373714+0000", 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2904000000000002e-05 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373721+0000", 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0609999999999998e-06 2024-04-26T12:10:13.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373726+0000", 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2870000000000004e-06 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.380581+0000", 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068548410000000004 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.380661+0000", 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0215000000000004e-05 2024-04-26T12:10:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.380783+0000", 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121476 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382557+0000", 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017738140000000001 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386200+0000", 2024-04-26T12:10:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036437930000000002 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386257+0000", 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6645999999999999e-05 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386311+0000", 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3780999999999999e-05 2024-04-26T12:10:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:162 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.796257381, 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013269345, 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 162 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373734+0000", 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2129999999999998e-06 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373737+0000", 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373740+0000", 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6369999999999999e-06 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381599+0000", 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078590029999999998 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381657+0000", 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7948000000000002e-05 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381742+0000", 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5070999999999999e-05 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386318+0000", 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004576508 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386923+0000", 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000604369 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386965+0000", 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1708000000000001e-05 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387001+0000", 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6709999999999999e-05 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:163 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.796246748000002, 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013403248, 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 163 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373742+0000", 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373745+0000", 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:10:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373748+0000", 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373750+0000", 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.463e-06 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382013+0000", 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082630099999999995 2024-04-26T12:10:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382092+0000", 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8720999999999994e-05 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382214+0000", 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012222200000000001 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387012+0000", 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047978430000000004 2024-04-26T12:10:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387055+0000", 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3129e-05 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387105+0000", 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9372000000000001e-05 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387146+0000", 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1205999999999998e-05 2024-04-26T12:10:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:164 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.796230990000002, 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013509999999999999, 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 164 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373788+0000", 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0052999999999998e-05 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373796+0000", 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2290000000000003e-06 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373800+0000", 2024-04-26T12:10:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3189999999999999e-06 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382597+0000", 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087972889999999998 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382675+0000", 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8343999999999994e-05 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382796+0000", 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120531 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387186+0000", 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043906459999999998 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387194+0000", 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3069999999999997e-06 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387233+0000", 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9804e-05 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387268+0000", 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4867999999999999e-05 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:165 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.796186439, 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013631885999999999, 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 165 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373805+0000", 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1110000000000002e-06 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373810+0000", 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373813+0000", 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4419999999999998e-06 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386360+0000", 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012547106000000001 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386446+0000", 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386582+0000", 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136236 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387277+0000", 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694698 2024-04-26T12:10:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387391+0000", 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113725 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387416+0000", 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5188999999999999e-05 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387435+0000", 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8717000000000001e-05 2024-04-26T12:10:13.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800761889, 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012500778000000001, 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:13.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369232+0000", 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3870000000000003e-06 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369240+0000", 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8019999999999992e-06 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369246+0000", 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3749999999999999e-06 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369890+0000", 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064422500000000001 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370040+0000", 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014978800000000001 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370870+0000", 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082954299999999997 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.377571+0000", 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067017259999999999 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381629+0000", 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040575139999999999 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381684+0000", 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5229999999999998e-05 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381728+0000", 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3964999999999997e-05 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800735207999999, 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012625117999999999, 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369286+0000", 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2366000000000001e-05 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369303+0000", 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6663999999999998e-05 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369309+0000", 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.764e-06 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.371411+0000", 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00210158 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.372222+0000", 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000811373 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.372380+0000", 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015714 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378975+0000", 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065955609999999998 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381814+0000", 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002838967 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381848+0000", 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.362e-05 2024-04-26T12:10:13.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381879+0000", 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1538999999999997e-05 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800671826999999, 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012714021000000001, 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:13.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369322+0000", 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369328+0000", 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8839999999999997e-06 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369334+0000", 2024-04-26T12:10:13.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9150000000000001e-06 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376462+0000", 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071274550000000004 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376544+0000", 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1843999999999998e-05 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376714+0000", 2024-04-26T12:10:13.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017050400000000001 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380051+0000", 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033371189999999999 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381943+0000", 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018913689999999999 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381989+0000", 2024-04-26T12:10:13.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6717e-05 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382031+0000", 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2126999999999998e-05 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800649753999998, 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013541195000000001, 2024-04-26T12:10:13.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369339+0000", 2024-04-26T12:10:13.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369343+0000", 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369350+0000", 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1570000000000003e-06 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369356+0000", 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380245+0000", 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010889272 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380388+0000", 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014244799999999999 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380794+0000", 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000406272 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382778+0000", 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019838590000000001 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382829+0000", 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1394000000000003e-05 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382860+0000", 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0555999999999997e-05 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382881+0000", 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.103e-05 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800628748000001, 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013570262, 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369360+0000", 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369363+0000", 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.326e-06 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369371+0000", 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:10:13.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369376+0000", 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381153+0000", 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011776371000000001 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381240+0000", 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7603999999999997e-05 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381360+0000", 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011987 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382818+0000", 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014577539999999999 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382888+0000", 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0110999999999993e-05 2024-04-26T12:10:13.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382912+0000", 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4270999999999999e-05 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382931+0000", 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8471e-05 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800607956, 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014056391999999999, 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369385+0000", 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7639999999999999e-06 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369391+0000", 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369396+0000", 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.31e-06 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382075+0000", 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012678952 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382146+0000", 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0817999999999999e-05 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382232+0000", 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6238999999999999e-05 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383023+0000", 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00079041699999999996 2024-04-26T12:10:13.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383384+0000", 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036165299999999997 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383418+0000", 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4171000000000002e-05 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383438+0000", 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:10:13.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800572395, 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015550154, 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:13.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369416+0000", 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369429+0000", 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2826000000000001e-05 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369438+0000", 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8349999999999993e-06 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369445+0000", 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5869999999999998e-06 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382426+0000", 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012981670000000001 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382511+0000", 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4915999999999998e-05 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382605+0000", 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4176000000000001e-05 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383461+0000", 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085609599999999998 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384909+0000", 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00144746 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384941+0000", 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2209999999999998e-05 2024-04-26T12:10:13.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384967+0000", 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.599e-05 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369483+0000", 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800506159000001, 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011763920000000001, 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.237 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369483+0000", 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369483+0000", 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369483+0000", 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369487+0000", 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369494+0000", 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369501+0000", 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4420000000000003e-06 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374071+0000", 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045696670000000003 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374186+0000", 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115085 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374821+0000", 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063561200000000003 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378950+0000", 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004128334 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381149+0000", 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002199861 2024-04-26T12:10:13.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381201+0000", 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1718000000000002e-05 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381247+0000", 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5884999999999999e-05 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800482730999999, 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012938036999999999, 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:13.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369506+0000", 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369517+0000", 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1212999999999999e-05 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369524+0000", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0960000000000003e-06 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369534+0000", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8390000000000002e-06 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374150+0000", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046155700000000003 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374820+0000", 2024-04-26T12:10:13.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067048499999999996 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374962+0000", 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141936 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378959+0000", 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039968160000000003 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382351+0000", 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003391813 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382388+0000", 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7075e-05 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382445+0000", 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6560000000000001e-05 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800436490999999, 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013278130000000001, 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369552+0000", 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369556+0000", 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0559999999999998e-06 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369566+0000", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0131e-05 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369572+0000", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1319999999999999e-06 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375385+0000", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058125659999999999 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375915+0000", 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000529898 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376132+0000", 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000217247 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.379294+0000", 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031621560000000002 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382748+0000", 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034539699999999998 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382796+0000", 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7772999999999998e-05 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382831+0000", 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4848999999999998e-05 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369631+0000", 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800357869999999, 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011765628, 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369631+0000", 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369631+0000", 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369631+0000", 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369635+0000", 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369643+0000", 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7440000000000007e-06 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369655+0000", 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1634000000000001e-05 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375370+0000", 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057154859999999997 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376113+0000", 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074322500000000003 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376253+0000", 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140097 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.379705+0000", 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003451595 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381292+0000", 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015870249999999999 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381341+0000", 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9193000000000001e-05 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381397+0000", 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5878000000000003e-05 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369700+0000", 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800289110000001, 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012155317000000001, 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369700+0000", 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369700+0000", 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369700+0000", 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369711+0000", 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1124000000000001e-05 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369718+0000", 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3459999999999996e-06 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369724+0000", 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9939999999999997e-06 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.377432+0000", 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077077279999999996 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.377635+0000", 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020350899999999999 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.377787+0000", 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000151612 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380738+0000", 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002951174 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381773+0000", 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010348029999999999 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381815+0000", 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2511e-05 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381855+0000", 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0086000000000002e-05 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369730+0000", 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800259695000001, 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012289147, 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369730+0000", 2024-04-26T12:10:13.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369730+0000", 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369729+0000", 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369733+0000", 2024-04-26T12:10:13.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3560000000000001e-06 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369739+0000", 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3910000000000003e-06 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369762+0000", 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3470999999999999e-05 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370911+0000", 2024-04-26T12:10:13.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011481639999999999 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.371039+0000", 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012849199999999999 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.371189+0000", 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015031500000000001 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375914+0000", 2024-04-26T12:10:13.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047246390000000001 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381921+0000", 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006006572 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381977+0000", 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6737999999999998e-05 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382019+0000", 2024-04-26T12:10:13.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1446999999999998e-05 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369777+0000", 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800212123000001, 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011918995, 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369777+0000", 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369777+0000", 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369776+0000", 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369783+0000", 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369791+0000", 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5420000000000005e-06 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369801+0000", 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0860000000000008e-06 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369903+0000", 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010249799999999999 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370052+0000", 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014887099999999999 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370212+0000", 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000159648 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376521+0000", 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063098310000000001 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381097+0000", 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045756039999999996 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381638+0000", 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054091100000000004 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381696+0000", 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8233999999999998e-05 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369811+0000", 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.800177812000001, 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012182975, 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:13.273 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369811+0000", 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369811+0000", 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369811+0000", 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369814+0000", 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9660000000000001e-06 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369821+0000", 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8870000000000003e-06 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369827+0000", 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2809999999999997e-06 2024-04-26T12:10:13.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378551+0000", 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008723639 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378666+0000", 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115012 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381994+0000", 2024-04-26T12:10:13.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033288160000000001 2024-04-26T12:10:13.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:13.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:13.277 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:13.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-26T12:10:13.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:13.280 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:13.278+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:13.378 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:13.377+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: "ops": [ 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4480, 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.50d7817f", 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:13.431 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4479", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4479", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.733882s", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0029999520000000002, 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.427887+0000", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.432 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4482, 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.b149bdc2", 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4481", 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4481", 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.734882s", 2024-04-26T12:10:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.001999968, 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.428221+0000", 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4483, 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.e8db50df", 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:13.434 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4482", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4482", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.734882s", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.001999968, 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.428261+0000", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.435 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4488, 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.30635572", 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4487", 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4487", 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.436 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429064+0000", 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4491, 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.32156e52", 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:13.437 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4490", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4490", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429253+0000", 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.438 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4492, 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.dd5d0be7", 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4491", 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4491", 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.439 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429558+0000", 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4485, 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.84eaf48d", 2024-04-26T12:10:13.440 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4484", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4484", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.734882s", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.001999968, 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.428586+0000", 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.441 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4486, 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.c076c5cb", 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4485", 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4485", 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.442 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.734882s", 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.001999968, 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.428933+0000", 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4489, 2024-04-26T12:10:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.9845cd88", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4488", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4488", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429108+0000", 2024-04-26T12:10:13.444 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4495, 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.7b773234", 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4494", 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4494", 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.445 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429636+0000", 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4484, 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.4bd8140c", 2024-04-26T12:10:13.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4483", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4483", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.734882s", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.001999968, 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.428567+0000", 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.447 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4487, 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.94f62665", 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4486", 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4486", 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.448 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.428992+0000", 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4490, 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.4ce7a7e5", 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:13.449 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4489", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4489", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429234+0000", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.450 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4493, 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.880d3773", 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4492", 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4492", 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.451 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429587+0000", 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4494, 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.d6170ae5", 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4493", 2024-04-26T12:10:13.452 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4493", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429607+0000", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "tid": 4496, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "pg": "5.887a0b4c", 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "object_id": "benchmark_data_smithi045_43640_object4495", 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "object_locator": "@5", 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_id": "benchmark_data_smithi045_43640_object4495", 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "target_object_locator": "@5", 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "paused": 0, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "used_replica": 0, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "precalc_pgid": 0, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "last_sent": "965.735882s", 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.00099998399999999999, 2024-04-26T12:10:13.454 INFO:teuthology.orchestra.run.smithi045.stdout: "attempts": 1, 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "snapid": "head", 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_context": "0=[]", 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "mtime": "2024-04-26T12:10:13.429736+0000", 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_ops": [ 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "write 0~65536 in=65536b" 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ops": [], 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ops": [], 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_stat_ops": [], 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_ops": [], 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout: "command_ops": [] 2024-04-26T12:10:13.455 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:10:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:10:13.457 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 4480, "pg": "5.50d7817f", "osd": 0, "object_id": "benchmark_data_smithi045_43640_object4479", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4479", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.733882s", "age": 0.0029999520000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.427887+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4482, "pg": "5.b149bdc2", "osd": 0, "object_id": "benchmark_data_smithi045_43640_object4481", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4481", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.734882s", "age": 0.001999968, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.428221+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4483, "pg": "5.e8db50df", "osd": 0, "object_id": "benchmark_data_smithi045_43640_object4482", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4482", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.734882s", "age": 0.001999968, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.428261+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4488, "pg": "5.30635572", "osd": 0, "object_id": "benchmark_data_smithi045_43640_object4487", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4487", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429064+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4491, "pg": "5.32156e52", "osd": 0, "object_id": "benchmark_data_smithi045_43640_object4490", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4490", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429253+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4492, "pg": "5.dd5d0be7", "osd": 0, "object_id": "benchmark_data_smithi045_43640_object4491", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4491", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429558+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4485, "pg": "5.84eaf48d", "osd": 1, "object_id": "benchmark_data_smithi045_43640_object4484", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4484", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.734882s", "age": 0.001999968, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.428586+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4486, "pg": "5.c076c5cb", "osd": 1, "object_id": "benchmark_data_smithi045_43640_object4485", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4485", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.734882s", "age": 0.001999968, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.428933+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4489, "pg": "5.9845cd88", "osd": 1, "object_id": "benchmark_data_smithi045_43640_object4488", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4488", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429108+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4495, "pg": "5.7b773234", "osd": 1, "object_id": "benchmark_data_smithi045_43640_object4494", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4494", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429636+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4484, "pg": "5.4bd8140c", "osd": 2, "object_id": "benchmark_data_smithi045_43640_object4483", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4483", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.734882s", "age": 0.001999968, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.428567+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4487, "pg": "5.94f62665", "osd": 2, "object_id": "benchmark_data_smithi045_43640_object4486", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4486", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.428992+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4490, "pg": "5.4ce7a7e5", "osd": 2, "object_id": "benchmark_data_smithi045_43640_object4489", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4489", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429234+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4493, "pg": "5.880d3773", "osd": 2, "object_id": "benchmark_data_smithi045_43640_object4492", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4492", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429587+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4494, "pg": "5.d6170ae5", "osd": 2, "object_id": "benchmark_data_smithi045_43640_object4493", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4493", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429607+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4496, "pg": "5.887a0b4c", "osd": 2, "object_id": "benchmark_data_smithi045_43640_object4495", "object_locator": "@5", "target_object_id": "benchmark_data_smithi045_43640_object4495", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "965.735882s", "age": 0.00099998399999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T12:10:13.429736+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-26T12:10:13.457 DEBUG:teuthology.orchestra.run.smithi045:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:4728 5.f e20/17 5:f71a1014:::benchmark_data_smithi045_43640_object4727:head v 20'311, mlcod=20'309)", 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:13.471432+0000", 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00062173299999999996, 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00064481499999999997, 2024-04-26T12:10:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471432+0000", 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471432+0000", 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471432+0000", 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471520+0000", 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8663000000000001e-05 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471532+0000", 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1694e-05 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471538+0000", 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4150000000000004e-06 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471580+0000", 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1588000000000002e-05 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471604+0000", 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4065000000000001e-05 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.476 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:4731 5.b 5:d5acd417:::benchmark_data_smithi045_43640_object4730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:13.471690+0000", 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00036431400000000002, 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00046961399999999998, 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 4731 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.477 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471690+0000", 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471690+0000", 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471689+0000", 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471771+0000", 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2553999999999996e-05 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471784+0000", 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2452999999999999e-05 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471792+0000", 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.157e-06 2024-04-26T12:10:13.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471828+0000", 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5778999999999997e-05 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471906+0000", 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8343999999999994e-05 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.471983+0000", 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7497999999999996e-05 2024-04-26T12:10:13.480 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:4733 5.d 5:b3d5ed55:::benchmark_data_smithi045_43640_object4732:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:13.472024+0000", 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.0357000000000001e-05, 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00022812599999999999, 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 4733 2024-04-26T12:10:13.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472024+0000", 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472024+0000", 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472023+0000", 2024-04-26T12:10:13.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472133+0000", 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109813 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472142+0000", 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0909999999999999e-06 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472147+0000", 2024-04-26T12:10:13.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472186+0000", 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8645e-05 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:4729 5.f e20/17 5:f0b8c366:::benchmark_data_smithi045_43640_object4728:head v 20'312, mlcod=20'309)", 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:13.472073+0000", 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9999804, 2024-04-26T12:10:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00025424900000000001, 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472073+0000", 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472073+0000", 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472073+0000", 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472193+0000", 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119682 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472199+0000", 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8479999999999997e-06 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472204+0000", 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472231+0000", 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6669000000000002e-05 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472242+0000", 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1873e-05 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:4734 5.8 5:196f34ba:::benchmark_data_smithi045_43640_object4733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:13.472158+0000", 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998965, 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00024634800000000002, 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 4734 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.488 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472158+0000", 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472158+0000", 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472157+0000", 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472243+0000", 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5833000000000003e-05 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472248+0000", 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472253+0000", 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7949999999999998e-06 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472289+0000", 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5660000000000001e-05 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472403+0000", 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113782 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:4737 5.0 5:00d2defa:::benchmark_data_smithi045_43640_object4736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:13.491 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:13.472260+0000", 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997945, 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000230475, 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 4737 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472260+0000", 2024-04-26T12:10:13.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472260+0000", 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472259+0000", 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472403+0000", 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000143516 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472408+0000", 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8470000000000001e-06 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472412+0000", 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8319999999999999e-06 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:13.472442+0000", 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0188999999999998e-05 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 6 2024-04-26T12:10:13.495 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:13.497 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:13.497 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:13.495+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:13.553 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-26T12:10:13.573 DEBUG:teuthology.parallel:result is None 2024-04-26T12:10:13.573 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-26T12:10:13.582 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-26T12:10:13.582 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-26T12:10:13.598 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:13.597+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:13.602 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 1 16 5542 5526 345.35 345.375 0.00440125 0.00288662 2024-04-26T12:10:13.699 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:13.698+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:13.745 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:13.745 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:13.745 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:13.745 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:13.745 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:13.761 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:13.800 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:13.799+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:13.900 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:13.899+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:13.955 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:13.955 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:13.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.366288+0000", 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.586016621999999, 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011467621000000001, 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366288+0000", 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366288+0000", 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366283+0000", 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999957 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366296+0000", 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3404000000000001e-05 2024-04-26T12:10:13.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366309+0000", 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.204e-05 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366322+0000", 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3664e-05 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368535+0000", 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002212393 2024-04-26T12:10:13.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368697+0000", 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016267300000000001 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368865+0000", 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016730599999999999 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373026+0000", 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.004161077 2024-04-26T12:10:13.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.377671+0000", 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0046451670000000004 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.377717+0000", 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.587e-05 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.377755+0000", 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8525000000000001e-05 2024-04-26T12:10:13.960 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.585545845999999, 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013096059, 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:13.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366763+0000", 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4530000000000001e-06 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366772+0000", 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.251e-06 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366783+0000", 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0886999999999999e-05 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370530+0000", 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037465969999999999 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370615+0000", 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5364999999999993e-05 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370790+0000", 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017513300000000001 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373719+0000", 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002928614 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379758+0000", 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060387740000000002 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379803+0000", 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5123999999999997e-05 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379854+0000", 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1637e-05 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.584962948000001, 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012775111, 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.966 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367340+0000", 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367348+0000", 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.311e-06 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367368+0000", 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0517999999999999e-05 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367378+0000", 2024-04-26T12:10:13.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8770000000000005e-06 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371711+0000", 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00433287 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371850+0000", 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013893099999999999 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371990+0000", 2024-04-26T12:10:13.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000140288 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373945+0000", 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019548970000000001 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380017+0000", 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060725060000000001 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380069+0000", 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1909000000000001e-05 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380116+0000", 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6941999999999999e-05 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.583805745999999, 2024-04-26T12:10:13.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012850874999999999, 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368504+0000", 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368514+0000", 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0190000000000001e-05 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368523+0000", 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9509999999999995e-06 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.372499+0000", 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039758789999999999 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373036+0000", 2024-04-26T12:10:13.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00053641300000000002 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373189+0000", 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000153029 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.374345+0000", 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001156453 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381242+0000", 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068968930000000003 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381300+0000", 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8038000000000002e-05 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381349+0000", 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9258000000000002e-05 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.583771984999998, 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0084202110000000004, 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368535+0000", 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7039999999999999e-06 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368540+0000", 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4310000000000002e-06 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368543+0000", 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2890000000000002e-06 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368592+0000", 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8374000000000001e-05 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368721+0000", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012943000000000001 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368865+0000", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014384599999999999 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373661+0000", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0047964059999999996 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.376826+0000", 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031642469999999998 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.376906+0000", 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9944999999999994e-05 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.376952+0000", 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6870999999999999e-05 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368551+0000", 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.583753425000001, 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010800506, 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368551+0000", 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368551+0000", 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368550+0000", 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368553+0000", 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9660000000000001e-06 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368561+0000", 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7030000000000006e-06 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368566+0000", 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6809999999999997e-06 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.369508+0000", 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00094275200000000004 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.369622+0000", 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113542 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.369814+0000", 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000191764 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373667+0000", 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0038529839999999998 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379176+0000", 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055094749999999998 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379255+0000", 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8427e-05 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379351+0000", 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6620999999999995e-05 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.986 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.583717972999999, 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012764034, 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:13.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368585+0000", 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368591+0000", 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:10:13.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368597+0000", 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7460000000000003e-06 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368602+0000", 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0799999999999996e-06 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373059+0000", 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044562059999999999 2024-04-26T12:10:13.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373178+0000", 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011930900000000001 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373318+0000", 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014009499999999999 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.374382+0000", 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001064382 2024-04-26T12:10:13.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381272+0000", 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068900719999999997 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381312+0000", 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9266e-05 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381350+0000", 2024-04-26T12:10:13.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8510000000000002e-05 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368606+0000", 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 24.583698256000002, 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0086077689999999995, 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368606+0000", 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368606+0000", 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368605+0000", 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368607+0000", 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0669999999999999e-06 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368611+0000", 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368617+0000", 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0839999999999997e-06 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368663+0000", 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6295999999999999e-05 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368791+0000", 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127639 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.377214+0000", 2024-04-26T12:10:13.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0084225940000000003 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:210 5.4 5:2f403605:::benchmark_data_smithi045_43640_object209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.654651+0000", 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.297652705, 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0076754140000000002, 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:13.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 210 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654651+0000", 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654651+0000", 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654651+0000", 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654678+0000", 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7362e-05 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654684+0000", 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7069999999999997e-06 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654692+0000", 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7589999999999997e-06 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654722+0000", 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9691000000000001e-05 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654827+0000", 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000105133 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:13.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654935+0000", 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010787500000000001 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.655492+0000", 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00055785899999999996 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.662271+0000", 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067785429999999997 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.662307+0000", 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6288000000000002e-05 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.662327+0000", 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9652000000000001e-05 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:212 5.e 5:7de6373d:::benchmark_data_smithi045_43640_object211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.001 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.654769+0000", 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.29753505, 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0069650570000000002, 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 212 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654769+0000", 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654769+0000", 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654769+0000", 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654915+0000", 2024-04-26T12:10:14.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000146873 2024-04-26T12:10:14.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654922+0000", 2024-04-26T12:10:14.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0669999999999997e-06 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654925+0000", 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.912e-06 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.654950+0000", 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4924999999999999e-05 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.655043+0000", 2024-04-26T12:10:14.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2251999999999997e-05 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.655145+0000", 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102569 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.655703+0000", 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00055777500000000005 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.661666+0000", 2024-04-26T12:10:14.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0059635160000000003 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.661711+0000", 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4892999999999999e-05 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.661734+0000", 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2829000000000001e-05 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:651 5.0 5:0233e06e:::benchmark_data_smithi045_43640_object650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.751575+0000", 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.2007288190000001, 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0087187359999999995, 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 651 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751575+0000", 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751575+0000", 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751575+0000", 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751640+0000", 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5480000000000003e-05 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751648+0000", 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3139999999999998e-06 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751652+0000", 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5900000000000001e-06 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751683+0000", 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0923000000000002e-05 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751772+0000", 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9151000000000001e-05 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.751862+0000", 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9858999999999995e-05 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.752455+0000", 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00059285100000000003 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.760189+0000", 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0077341939999999998 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.760273+0000", 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4289000000000006e-05 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.760294+0000", 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.071e-05 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:680 5.e 5:711c4cda:::benchmark_data_smithi045_43640_object679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.761066+0000", 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.1912381990000001, 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0077843670000000004, 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.013 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 680 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761066+0000", 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761066+0000", 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761065+0000", 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761190+0000", 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012524300000000001 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761199+0000", 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0150000000000003e-06 2024-04-26T12:10:14.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761204+0000", 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761236+0000", 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1720000000000001e-05 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761344+0000", 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000108006 2024-04-26T12:10:14.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.761473+0000", 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129379 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.762109+0000", 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00063530699999999999 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.768767+0000", 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066580420000000003 2024-04-26T12:10:14.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.768808+0000", 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1389e-05 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.768850+0000", 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2120000000000003e-05 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.018 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:684 5.4 5:241aa369:::benchmark_data_smithi045_43640_object683:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.762965+0000", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.189338724, 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0083177340000000002, 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 684 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.762965+0000", 2024-04-26T12:10:14.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.762965+0000", 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.762965+0000", 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763055+0000", 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9964999999999997e-05 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763062+0000", 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0690000000000004e-06 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763066+0000", 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3409999999999996e-06 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763094+0000", 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7965000000000001e-05 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763174+0000", 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0017000000000003e-05 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763263+0000", 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9049999999999996e-05 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763813+0000", 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00054929200000000005 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771166+0000", 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073530119999999999 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771208+0000", 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2565000000000003e-05 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771283+0000", 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5000999999999996e-05 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:686 5.e 5:7e04c3c8:::benchmark_data_smithi045_43640_object685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.763391+0000", 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.188913339, 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0078840420000000008, 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.024 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 686 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763391+0000", 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763391+0000", 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763390+0000", 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763455+0000", 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4712e-05 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763465+0000", 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0567999999999999e-05 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763473+0000", 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3409999999999997e-06 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763502+0000", 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9836e-05 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763608+0000", 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000105733 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763744+0000", 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136219 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764339+0000", 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00059501699999999999 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771230+0000", 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068904350000000003 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771258+0000", 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8010000000000001e-05 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771275+0000", 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.6983e-05 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:693 5.8 5:138ce364:::benchmark_data_smithi045_43640_object692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.763811+0000", 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.1884933580000001, 2024-04-26T12:10:14.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.007387546, 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 693 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763811+0000", 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763811+0000", 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763810+0000", 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763853+0000", 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2392999999999999e-05 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763858+0000", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7819999999999999e-06 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763862+0000", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.878e-06 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763895+0000", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2670999999999999e-05 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764001+0000", 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106517 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764096+0000", 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4758000000000003e-05 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764901+0000", 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00080435399999999996 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771141+0000", 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.006240631 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771174+0000", 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2721000000000001e-05 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771198+0000", 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4482999999999999e-05 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.034 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:695 5.0 5:0badf2a2:::benchmark_data_smithi045_43640_object694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.763944+0000", 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.1883606019999999, 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.007297113, 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 695 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.035 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763944+0000", 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763944+0000", 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763943+0000", 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763971+0000", 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7659000000000001e-05 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763979+0000", 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7409999999999992e-06 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.763984+0000", 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764013+0000", 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8575999999999999e-05 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764093+0000", 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0117000000000006e-05 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764192+0000", 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8787000000000001e-05 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.764916+0000", 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00072451899999999997 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771179+0000", 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00626277 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771218+0000", 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9447999999999999e-05 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.771241+0000", 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2399999999999999e-05 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:750 5.0 5:0b17ba48:::benchmark_data_smithi045_43640_object749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.781534+0000", 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.170770002, 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0069853210000000001, 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.040 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 750 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.781534+0000", 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.781534+0000", 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.781534+0000", 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.781570+0000", 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5957000000000001e-05 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.781578+0000", 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6689999999999995e-06 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.781584+0000", 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0340000000000002e-06 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.783019+0000", 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434325 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.783094+0000", 2024-04-26T12:10:14.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5519999999999995e-05 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.783182+0000", 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7499999999999999e-05 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.783607+0000", 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000425363 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.788478+0000", 2024-04-26T12:10:14.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048707359999999996 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.788501+0000", 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3351999999999999e-05 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.788520+0000", 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8425999999999999e-05 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:1075 5.b 5:dbe3bd15:::benchmark_data_smithi045_43640_object1074:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.856466+0000", 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.095837782, 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0086096790000000003, 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 1075 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856466+0000", 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856466+0000", 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856466+0000", 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856607+0000", 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014147300000000001 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856615+0000", 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9580000000000007e-06 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856620+0000", 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2310000000000004e-06 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856652+0000", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1619999999999999e-05 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856731+0000", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8875999999999995e-05 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.856811+0000", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0388000000000004e-05 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857304+0000", 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00049280400000000001 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.865032+0000", 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0077277689999999998 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.865057+0000", 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5530000000000001e-05 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.865076+0000", 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8635e-05 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:1077 5.e 5:7bd5cb30:::benchmark_data_smithi045_43640_object1076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.857808+0000", 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.0944962490000001, 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073771920000000003, 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.051 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 1077 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857808+0000", 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857808+0000", 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857807+0000", 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857884+0000", 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6872999999999994e-05 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857892+0000", 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.695e-06 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857896+0000", 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857922+0000", 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5680000000000001e-05 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.857997+0000", 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4772999999999997e-05 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.858076+0000", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9385e-05 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.858483+0000", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00040665800000000001 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.865060+0000", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065770150000000003 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.865130+0000", 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0294000000000002e-05 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.865185+0000", 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4873000000000001e-05 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:1194 5.b 5:dbc168a9:::benchmark_data_smithi045_43640_object1193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:12.885949+0000", 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.0663547980000001, 2024-04-26T12:10:14.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0069207130000000002, 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 1194 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.885949+0000", 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.885949+0000", 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.885949+0000", 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886018+0000", 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9301999999999995e-05 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886027+0000", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0759999999999992e-06 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886034+0000", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6479999999999997e-06 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886059+0000", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5508999999999999e-05 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:14.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886130+0000", 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0889000000000005e-05 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886223+0000", 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2860000000000002e-05 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.886680+0000", 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00045711500000000002 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.892786+0000", 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061060359999999996 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.892836+0000", 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9654999999999998e-05 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:12.892870+0000", 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4282000000000001e-05 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:14.061 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:14.062 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:14.063 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:14.062+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:14.063 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:14.165 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:14.164+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:14.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:14.254 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8884 5.2 e20/17 5:473218bb:::benchmark_data_smithi045_43640_object8883:head v 20'535, mlcod=20'532)", 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.002106208, 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021392490000000002, 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250593+0000", 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4833000000000007e-05 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250604+0000", 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0824e-05 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250611+0000", 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250645+0000", 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3172e-05 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250662+0000", 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7577000000000001e-05 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.258 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8885 5.0 e20/17 5:05f43a42:::benchmark_data_smithi045_43640_object8884:head v 20'583, mlcod=20'580)", 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250686+0000", 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00193968, 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002032481, 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250686+0000", 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250686+0000", 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250685+0000", 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250752+0000", 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6792999999999996e-05 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250760+0000", 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8660000000000006e-06 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250765+0000", 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8810000000000001e-06 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250799+0000", 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3927999999999998e-05 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250818+0000", 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8868e-05 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8886 5.6 5:6e110f1a:::benchmark_data_smithi045_43640_object8885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250840+0000", 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0017855880000000001, 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001930881, 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8886 2024-04-26T12:10:14.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.264 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250840+0000", 2024-04-26T12:10:14.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250840+0000", 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250839+0000", 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250951+0000", 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011249899999999999 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250962+0000", 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1413000000000001e-05 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250970+0000", 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6890000000000004e-06 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251001+0000", 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1077000000000001e-05 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251091+0000", 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0173000000000006e-05 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251172+0000", 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1000000000000004e-05 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252513+0000", 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001340854 2024-04-26T12:10:14.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8888 5.a 5:556d5465:::benchmark_data_smithi045_43640_object8887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250986+0000", 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0016393009999999999, 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00185513, 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:14.270 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8888 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250986+0000", 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250986+0000", 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250985+0000", 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251037+0000", 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1657999999999999e-05 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251046+0000", 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0289999999999994e-06 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251052+0000", 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5309999999999998e-06 2024-04-26T12:10:14.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251087+0000", 2024-04-26T12:10:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4922000000000002e-05 2024-04-26T12:10:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251171+0000", 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3225000000000004e-05 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251262+0000", 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1045000000000007e-05 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252666+0000", 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014047420000000001 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.276 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8889 5.5 5:a518cd91:::benchmark_data_smithi045_43640_object8888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001561776, 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001879822, 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8889 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:14.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251164+0000", 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010094699999999999 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251174+0000", 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0149000000000001e-05 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251180+0000", 2024-04-26T12:10:14.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251215+0000", 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4943000000000001e-05 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251331+0000", 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000115528 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251469+0000", 2024-04-26T12:10:14.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013852600000000001 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252716+0000", 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012466840000000001 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8893 5.5 5:ab2ea7dc:::benchmark_data_smithi045_43640_object8892:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251189+0000", 2024-04-26T12:10:14.281 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0014364919999999999, 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018437760000000001, 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8893 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251189+0000", 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251189+0000", 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251188+0000", 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251324+0000", 2024-04-26T12:10:14.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135854 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251334+0000", 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.027e-05 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251341+0000", 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.204e-06 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251958+0000", 2024-04-26T12:10:14.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00061636500000000001 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252086+0000", 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012848699999999999 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252223+0000", 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013621299999999999 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8887 5.4 e20/17 5:2f729b2c:::benchmark_data_smithi045_43640_object8886:head v 20'563, mlcod=20'561)", 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001209009, 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016933339999999999, 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251453+0000", 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7218999999999997e-05 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251460+0000", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9700000000000002e-06 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251465+0000", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1699999999999996e-06 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251503+0000", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7611000000000003e-05 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251522+0000", 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9528999999999999e-05 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8897 5.a 5:5c8eb00a:::benchmark_data_smithi045_43640_object8896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251386+0000", 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001239467, 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001793993, 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8897 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251386+0000", 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251386+0000", 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251385+0000", 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251499+0000", 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011377 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251509+0000", 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.004e-05 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251516+0000", 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6090000000000003e-06 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251935+0000", 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00041879200000000002 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252045+0000", 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000109373 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252165+0000", 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120866 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8891 5.7 e20/17 5:e9c6fa8a:::benchmark_data_smithi045_43640_object8890:head v 20'555, mlcod=20'552)", 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251684+0000", 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00094123500000000001, 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001575868, 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251684+0000", 2024-04-26T12:10:14.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251684+0000", 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251683+0000", 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251820+0000", 2024-04-26T12:10:14.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013628199999999999 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251828+0000", 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2160000000000006e-06 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251834+0000", 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9970000000000004e-06 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251862+0000", 2024-04-26T12:10:14.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7671e-05 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251883+0000", 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1855e-05 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8892 5.8 e20/17 5:1ec4722e:::benchmark_data_smithi045_43640_object8891:head v 20'564, mlcod=20'562)", 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251771+0000", 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000854417, 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001548319, 2024-04-26T12:10:14.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251771+0000", 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251771+0000", 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251770+0000", 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251837+0000", 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7121999999999999e-05 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251846+0000", 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5709999999999998e-06 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251853+0000", 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251885+0000", 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2740999999999997e-05 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251903+0000", 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7958999999999999e-05 2024-04-26T12:10:14.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8896 5.1 e20/17 5:8ae0dfb6:::benchmark_data_smithi045_43640_object8895:head v 20'523, mlcod=20'521)", 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251844+0000", 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00078129700000000002, 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001513583, 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251844+0000", 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251844+0000", 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251843+0000", 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251874+0000", 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0769000000000003e-05 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251881+0000", 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251886+0000", 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1229999999999999e-06 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251917+0000", 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0735999999999998e-05 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251935+0000", 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8020999999999999e-05 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8894 5.b e20/17 5:d28e84bb:::benchmark_data_smithi045_43640_object8893:head v 20'587, mlcod=20'585)", 2024-04-26T12:10:14.304 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.252381+0000", 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00024450299999999997, 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010117780000000001, 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252381+0000", 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252381+0000", 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252380+0000", 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252413+0000", 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2904000000000002e-05 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252423+0000", 2024-04-26T12:10:14.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5489999999999995e-06 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252433+0000", 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0854e-05 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252475+0000", 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1919999999999998e-05 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252496+0000", 2024-04-26T12:10:14.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0236000000000001e-05 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8895 5.8 e20/17 5:1a1d64bc:::benchmark_data_smithi045_43640_object8894:head v 20'565, mlcod=20'562)", 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.252463+0000", 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00016203800000000001, 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097019100000000002, 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252463+0000", 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252463+0000", 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252463+0000", 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252495+0000", 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1871e-05 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252501+0000", 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.122e-06 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252506+0000", 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8770000000000001e-06 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252538+0000", 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2135000000000003e-05 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252555+0000", 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7096999999999999e-05 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8898 5.7 e20/17 5:e4dc41bd:::benchmark_data_smithi045_43640_object8897:head v 20'556, mlcod=20'553)", 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.252679+0000", 2024-04-26T12:10:14.311 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999456, 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00080013100000000004, 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252679+0000", 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252679+0000", 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252679+0000", 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252776+0000", 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7561999999999999e-05 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252789+0000", 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3012e-05 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252796+0000", 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5019999999999998e-06 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252834+0000", 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8266999999999998e-05 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252853+0000", 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8567999999999999e-05 2024-04-26T12:10:14.314 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8899 5.b e20/17 5:d89ec7e6:::benchmark_data_smithi045_43640_object8898:head v 20'588, mlcod=20'585)", 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.252740+0000", 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9998856, 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00077758600000000003, 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252740+0000", 2024-04-26T12:10:14.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252740+0000", 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252739+0000", 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252799+0000", 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9655999999999999e-05 2024-04-26T12:10:14.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252806+0000", 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8539999999999999e-06 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252812+0000", 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252989+0000", 2024-04-26T12:10:14.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017616600000000001 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253001+0000", 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2670999999999999e-05 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8900 5.b e20/17 5:d33b62db:::benchmark_data_smithi045_43640_object8899:head v 20'589, mlcod=20'585)", 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.253323+0000", 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9993024, 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000227572, 2024-04-26T12:10:14.318 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253323+0000", 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253323+0000", 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:14.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253322+0000", 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253374+0000", 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1910000000000003e-05 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253384+0000", 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5850000000000006e-06 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:14.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253388+0000", 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4320000000000001e-06 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253411+0000", 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2592e-05 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253424+0000", 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2527999999999999e-05 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:14.321 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:14.322 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 16 2024-04-26T12:10:14.322 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:14.323 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:14.322+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:14.323 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:14.387 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:14.408 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:14.424 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:14.423+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:14.430 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:14.525 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:14.524+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:14.550 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:14.551 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:14.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:14.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 2 16 10325 10309 322.131 298.938 0.00252292 0.00309955 2024-04-26T12:10:14.651 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:14.650+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:14.727 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:14.727+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:14.789 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:14.789 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:14.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:14.828 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:14.827+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:14.929 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:14.928+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:14.988 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:14.989 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:15.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:15.030 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:15.029+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:15.131 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:15.130+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:15.223 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:15.223 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:15.234 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:15.233+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:15.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:15.335 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:15.334+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:15.438 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:15.435+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:15.449 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:15.449 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:15.459 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:10:15.463 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:15.537 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:15.536+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:15.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 3 16 14170 14154 294.855 240.312 0.00531121 0.00338743 2024-04-26T12:10:15.638 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:15.637+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:15.642 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:15.642 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:15.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:15.739 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:15.738+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:15.840 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:15.839+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:15.881 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:15.881 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:15.894 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:15.978 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:15.977+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:16.042 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:16.042+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:16.111 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:16.111 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:16.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:16.170 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:16.169+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:16.245 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:16.244+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:16.316 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:16.316 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:16.333 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:16.346 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:16.345+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:16.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:16.448 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:10:16.448 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:16.448 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:10:16.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:10:16.449 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:16.446+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:16.449 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:10:16.547 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:16.546+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:16.555 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:16.555 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:16.569 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:16.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 4 16 17872 17856 278.952 231.375 0.00432963 0.00358051 2024-04-26T12:10:16.632 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:16.648 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:16.647+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:16.654 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:16.676 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:16.750 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:16.748+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.396452363000002, 2024-04-26T12:10:16.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016256112, 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365793+0000", 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999952 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365806+0000", 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3039e-05 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365819+0000", 2024-04-26T12:10:16.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3132000000000001e-05 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365834+0000", 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365953+0000", 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011895700000000001 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:16.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375316+0000", 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093566369999999992 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375394+0000", 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7732999999999996e-05 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375472+0000", 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8182999999999993e-05 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381062+0000", 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055902030000000002 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381964+0000", 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090143000000000005 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382012+0000", 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8192999999999998e-05 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382054+0000", 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1936e-05 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:16.771 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.396390777000001, 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016298395, 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365858+0000", 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365864+0000", 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365873+0000", 2024-04-26T12:10:16.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365882+0000", 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4989999999999994e-06 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366075+0000", 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019275499999999999 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366080+0000", 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375717+0000", 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096367499999999995 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375784+0000", 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6649000000000005e-05 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375898+0000", 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011433 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381103+0000", 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052053610000000004 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382076+0000", 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097246799999999999 2024-04-26T12:10:16.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382121+0000", 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5714999999999999e-05 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382158+0000", 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6174999999999998e-05 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.396362608, 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:16.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:16.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.396290270000001, 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:16.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:16.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.396259735000001, 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016265910000000001, 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365994+0000", 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366006+0000", 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1816e-05 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366011+0000", 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368181+0000", 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021698279999999999 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368185+0000", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4900000000000002e-06 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376058+0000", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078721069999999997 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376139+0000", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0958000000000007e-05 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376224+0000", 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5680000000000006e-05 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381953+0000", 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057284379999999998 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382171+0000", 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021846100000000001 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382221+0000", 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9869e-05 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382256+0000", 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5182999999999998e-05 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:16.795 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.396023568, 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01469869, 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366232+0000", 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1530000000000002e-06 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366243+0000", 2024-04-26T12:10:16.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1103e-05 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366260+0000", 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022716699999999999 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368538+0000", 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9270000000000002e-06 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373128+0000", 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045899799999999996 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373834+0000", 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00070583699999999996 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374269+0000", 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00043562499999999998 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380083+0000", 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0058130949999999999 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380821+0000", 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00073799399999999995 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380880+0000", 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9001e-05 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380925+0000", 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5617e-05 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.801 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.394641755999999, 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01400622, 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367605+0000", 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999967 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367613+0000", 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5059999999999995e-06 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367625+0000", 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2114e-05 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367637+0000", 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1739999999999999e-05 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369337+0000", 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001699519 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369342+0000", 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374717+0000", 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053750869999999997 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375164+0000", 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00044635699999999998 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381614+0000", 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0064507310000000003 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.394604627, 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015300935, 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.806 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:16.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367648+0000", 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.659e-06 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367657+0000", 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367667+0000", 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368391+0000", 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072424000000000002 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368397+0000", 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6389999999999997e-06 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377728+0000", 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093318099999999994 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377867+0000", 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013898 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382946+0000", 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050788350000000003 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.810 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.368201+0000", 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.394048646000002, 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013449111999999999, 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368201+0000", 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368201+0000", 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368200+0000", 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368214+0000", 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3183999999999999e-05 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368225+0000", 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1449e-05 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368234+0000", 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3190000000000001e-06 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368303+0000", 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8448000000000006e-05 2024-04-26T12:10:16.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368310+0000", 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375247+0000", 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0069367689999999997 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375367+0000", 2024-04-26T12:10:16.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120376 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381650+0000", 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062832169999999998 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8884 5.2 e20/17 5:473218bb:::benchmark_data_smithi045_43640_object8883:head v 20'535, mlcod=20'532)", 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5117310269999997, 2024-04-26T12:10:16.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012799293, 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250519+0000", 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250593+0000", 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4833000000000007e-05 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250604+0000", 2024-04-26T12:10:16.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0824e-05 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250611+0000", 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250645+0000", 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3172e-05 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250662+0000", 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7577000000000001e-05 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263271+0000", 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012609178 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263318+0000", 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6955e-05 2024-04-26T12:10:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8885 5.0 e20/17 5:05f43a42:::benchmark_data_smithi045_43640_object8884:head v 20'583, mlcod=20'580)", 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250686+0000", 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5115644989999999, 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012646434, 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250686+0000", 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250686+0000", 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250685+0000", 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250752+0000", 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6792999999999996e-05 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250760+0000", 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8660000000000006e-06 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250765+0000", 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8810000000000001e-06 2024-04-26T12:10:16.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250799+0000", 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3927999999999998e-05 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250818+0000", 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8868e-05 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263294+0000", 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012475817 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263332+0000", 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7868999999999999e-05 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8886 5.6 5:6e110f1a:::benchmark_data_smithi045_43640_object8885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250840+0000", 2024-04-26T12:10:16.824 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5114104070000001, 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012595253000000001, 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8886 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250840+0000", 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250840+0000", 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250839+0000", 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250951+0000", 2024-04-26T12:10:16.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011249899999999999 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250962+0000", 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1413000000000001e-05 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250970+0000", 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6890000000000004e-06 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251001+0000", 2024-04-26T12:10:16.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1077000000000001e-05 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251091+0000", 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0173000000000006e-05 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251172+0000", 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1000000000000004e-05 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252513+0000", 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001340854 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263321+0000", 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010808066999999999 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263384+0000", 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2873999999999995e-05 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263435+0000", 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0640000000000003e-05 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8888 5.a 5:556d5465:::benchmark_data_smithi045_43640_object8887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.250986+0000", 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5112641199999999, 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012905922, 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.830 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8888 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250986+0000", 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250986+0000", 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.250985+0000", 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251037+0000", 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1657999999999999e-05 2024-04-26T12:10:16.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251046+0000", 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0289999999999994e-06 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251052+0000", 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5309999999999998e-06 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251087+0000", 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4922000000000002e-05 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251171+0000", 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3225000000000004e-05 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251262+0000", 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1045000000000007e-05 2024-04-26T12:10:16.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252666+0000", 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014047420000000001 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263812+0000", 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011145933 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263855+0000", 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2947000000000001e-05 2024-04-26T12:10:16.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263892+0000", 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6581000000000001e-05 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8889 5.5 5:a518cd91:::benchmark_data_smithi045_43640_object8888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5111865949999999, 2024-04-26T12:10:16.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012875111, 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8889 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251063+0000", 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251164+0000", 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010094699999999999 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251174+0000", 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0149000000000001e-05 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251180+0000", 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251215+0000", 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4943000000000001e-05 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251331+0000", 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000115528 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251469+0000", 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013852600000000001 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252716+0000", 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012466840000000001 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263849+0000", 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011132758 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263901+0000", 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2471e-05 2024-04-26T12:10:16.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263939+0000", 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7115e-05 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8893 5.5 5:ab2ea7dc:::benchmark_data_smithi045_43640_object8892:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251189+0000", 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5110613109999997, 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012833211000000001, 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.842 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8893 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251189+0000", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251189+0000", 2024-04-26T12:10:16.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251188+0000", 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251324+0000", 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135854 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251334+0000", 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.027e-05 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251341+0000", 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.204e-06 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251958+0000", 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00061636500000000001 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252086+0000", 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012848699999999999 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252223+0000", 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013621299999999999 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.254100+0000", 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001877585 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263947+0000", 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098468170000000008 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263989+0000", 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2187000000000001e-05 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.264022+0000", 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2787999999999998e-05 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.847 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:8897 5.a 5:5c8eb00a:::benchmark_data_smithi045_43640_object8896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251386+0000", 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5108642859999999, 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012596391, 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 8897 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.848 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251386+0000", 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251386+0000", 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251385+0000", 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:16.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251499+0000", 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011377 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251509+0000", 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.004e-05 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251516+0000", 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6090000000000003e-06 2024-04-26T12:10:16.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251935+0000", 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00041879200000000002 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252045+0000", 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000109373 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.252165+0000", 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120866 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.253473+0000", 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00130766 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263900+0000", 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010426869 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263950+0000", 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9838e-05 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263982+0000", 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2332000000000001e-05 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8887 5.4 e20/17 5:2f729b2c:::benchmark_data_smithi045_43640_object8886:head v 20'563, mlcod=20'561)", 2024-04-26T12:10:16.853 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.510833828, 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012467202, 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251416+0000", 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251453+0000", 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7218999999999997e-05 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251460+0000", 2024-04-26T12:10:16.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9700000000000002e-06 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251465+0000", 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1699999999999996e-06 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251503+0000", 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7611000000000003e-05 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251522+0000", 2024-04-26T12:10:16.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9528999999999999e-05 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263850+0000", 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012327794 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263883+0000", 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3488999999999997e-05 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8891 5.7 e20/17 5:e9c6fa8a:::benchmark_data_smithi045_43640_object8890:head v 20'555, mlcod=20'552)", 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251684+0000", 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5105660539999999, 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012217540000000001, 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251684+0000", 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251684+0000", 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251683+0000", 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251820+0000", 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013628199999999999 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251828+0000", 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2160000000000006e-06 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251834+0000", 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9970000000000004e-06 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251862+0000", 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7671e-05 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251883+0000", 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1855e-05 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263877+0000", 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011993408000000001 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263901+0000", 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4630999999999998e-05 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.861 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8892 5.8 e20/17 5:1ec4722e:::benchmark_data_smithi045_43640_object8891:head v 20'564, mlcod=20'562)", 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251771+0000", 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.5104792360000001, 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012238294, 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251771+0000", 2024-04-26T12:10:16.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251771+0000", 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251770+0000", 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251837+0000", 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7121999999999999e-05 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251846+0000", 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5709999999999998e-06 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251853+0000", 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8630000000000002e-06 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251885+0000", 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2740999999999997e-05 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251903+0000", 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7958999999999999e-05 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263984+0000", 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012081119 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.264009+0000", 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4567999999999999e-05 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:8896 5.1 e20/17 5:8ae0dfb6:::benchmark_data_smithi045_43640_object8895:head v 20'523, mlcod=20'521)", 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:14.251844+0000", 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.510406116, 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012010076, 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:16.866 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251844+0000", 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251844+0000", 2024-04-26T12:10:16.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:16.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:16.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251843+0000", 2024-04-26T12:10:16.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251874+0000", 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0769000000000003e-05 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251881+0000", 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5660000000000003e-06 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:16.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251886+0000", 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1229999999999999e-06 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251917+0000", 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0735999999999998e-05 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.251935+0000", 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8020999999999999e-05 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263828+0000", 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011892844 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:14.263854+0000", 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:16.872 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:16.874 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:16.873+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:16.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "238e0384-60e0-4b21-9d3a-782265888521", 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2024-04-26T12:09:34.034413+0000", 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2024-04-26T12:10:16.435496+0000", 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2024-04-26T12:09:41.810744+0000", 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2024-04-26T12:09:34.969233+0000", 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5804032, 2024-04-26T12:10:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "nodeep-scrub", 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 5, 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 3, 2024-04-26T12:10:16.877 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:42.899365+0000", 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:16.878 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:16.879 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "11", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:16.880 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:16.881 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:16.882 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2024-04-26T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:42.935107+0000", 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2024-04-26T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "12", 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:16.887 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:16.888 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.889 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 3, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:47.482562+0000", 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "15", 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2024-04-26T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 4, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:48.344147+0000", 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "16", 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:16.899 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:16.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:16.902 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 5, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "unique_pool_0", 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:10:10.173361+0000", 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:16.903 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 16, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 16, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 16, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 16, 2024-04-26T12:10:16.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 16, 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "19", 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:16.905 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:16.906 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:16.907 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "rados": {} 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:16.908 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "f5e89d15-234b-43fa-a34c-aa6987125af4", 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:16.909 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 18, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6800", 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6801", 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.911 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6802", 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6803", 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6806", 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6807", 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6804", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6805", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.71:6801/40435", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.71:6803/40435", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.71:6807/40435", 2024-04-26T12:10:16.914 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.71:6805/40435", 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "cacdbf9c-7e2f-46fa-9e34-804a2afdb53a", 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:16.915 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 17, 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6800", 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6801", 2024-04-26T12:10:16.916 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6802", 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6803", 2024-04-26T12:10:16.917 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6806", 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6807", 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6804", 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6805", 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.919 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.94:6801/40365", 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.94:6803/40365", 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.94:6807/40365", 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.94:6805/40365", 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "406b2884-83cb-4c28-885d-e6f9a3d25330", 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:16.920 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 17, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6800", 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6801", 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6802", 2024-04-26T12:10:16.922 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6803", 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6806", 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6807", 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6804", 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6805", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.104:6801/40673", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.104:6803/40673", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.104:6807/40673", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.104:6805/40673", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.925 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.032022+0000", 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:16.926 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.017304+0000", 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:16.927 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.048371+0000", 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [ 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "3.1d", 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: 0, 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: 1 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2024-04-26T12:10:16.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:16.929 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:16.930 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:10:16.931 INFO:tasks.thrashosds.thrasher:j is {'epoch': 21, 'fsid': '238e0384-60e0-4b21-9d3a-782265888521', 'created': '2024-04-26T12:09:34.034413+0000', 'modified': '2024-04-26T12:10:16.435496+0000', 'last_up_change': '2024-04-26T12:09:41.810744+0000', 'last_in_change': '2024-04-26T12:09:34.969233+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:09:47.482562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:09:48.344147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T12:10:10.173361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f5e89d15-234b-43fa-a34c-aa6987125af4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6801', 'nonce': 40435}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 40435}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6807', 'nonce': 40435}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6805', 'nonce': 40435}]}, 'public_addr': '172.21.15.71:6801/40435', 'cluster_addr': '172.21.15.71:6803/40435', 'heartbeat_back_addr': '172.21.15.71:6807/40435', 'heartbeat_front_addr': '172.21.15.71:6805/40435', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'cacdbf9c-7e2f-46fa-9e34-804a2afdb53a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6800', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6801', 'nonce': 40365}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6802', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6803', 'nonce': 40365}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6806', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6807', 'nonce': 40365}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6804', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6805', 'nonce': 40365}]}, 'public_addr': '172.21.15.94:6801/40365', 'cluster_addr': '172.21.15.94:6803/40365', 'heartbeat_back_addr': '172.21.15.94:6807/40365', 'heartbeat_front_addr': '172.21.15.94:6805/40365', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '406b2884-83cb-4c28-885d-e6f9a3d25330', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6800', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6801', 'nonce': 40673}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6802', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6803', 'nonce': 40673}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6806', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6807', 'nonce': 40673}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6804', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6805', 'nonce': 40673}]}, 'public_addr': '172.21.15.104:6801/40673', 'cluster_addr': '172.21.15.104:6803/40673', 'heartbeat_back_addr': '172.21.15.104:6807/40673', 'heartbeat_front_addr': '172.21.15.104:6805/40673', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.032022+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.017304+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.048371+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.1d', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:10:16.931 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T12:10:16.975 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:16.974+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.076 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:17.075+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:17.109 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:19623 5.1 5:8043daf4:::benchmark_data_smithi045_43640_object19622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:17.108236+0000", 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00062123799999999998, 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064292699999999995, 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 19623 2024-04-26T12:10:17.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108236+0000", 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108236+0000", 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108235+0000", 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108270+0000", 2024-04-26T12:10:17.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5122e-05 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108281+0000", 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1158000000000001e-05 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108290+0000", 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6000000000000007e-06 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108325+0000", 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5327999999999998e-05 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108469+0000", 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000143879 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108608+0000", 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013933199999999999 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:19626 5.1 5.21a867b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:17.108725+0000", 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.000132137, 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000201349, 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 19626 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.115 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108725+0000", 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108725+0000", 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108724+0000", 2024-04-26T12:10:17.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108838+0000", 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011434600000000001 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108848+0000", 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5580000000000006e-06 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108854+0000", 2024-04-26T12:10:17.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7629999999999997e-06 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:19611 5.1 5:83950635:::benchmark_data_smithi045_43640_object19610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:17.105013+0000", 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0038443240000000001, 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039556219999999998, 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 19611 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105013+0000", 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105013+0000", 2024-04-26T12:10:17.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105012+0000", 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105052+0000", 2024-04-26T12:10:17.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0278999999999998e-05 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105057+0000", 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0669999999999999e-06 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105061+0000", 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105128+0000", 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6923999999999998e-05 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105263+0000", 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013533100000000001 2024-04-26T12:10:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.105422+0000", 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015916300000000001 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.108233+0000", 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028106350000000001 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:19621 5.1 5:8cde2f9c:::benchmark_data_smithi045_43640_object19620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:17.106898+0000", 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0019588790000000002, 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021318159999999999, 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 19621 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.124 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.106898+0000", 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.106898+0000", 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.106897+0000", 2024-04-26T12:10:17.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.107005+0000", 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107753 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.107015+0000", 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.007e-05 2024-04-26T12:10:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.107022+0000", 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.107062+0000", 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9635999999999998e-05 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.107170+0000", 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108385 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:17.107262+0000", 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1232999999999999e-05 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 4 2024-04-26T12:10:17.128 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:17.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:17.215 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:17.214+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.279 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:17.278+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:17.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-26T12:10:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-26T12:10:17.351 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:17.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:17.407 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:17.406+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.483 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:17.481+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:17.583 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:17.582+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:161 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.208240472999996, 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012629592, 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 161 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373681+0000", 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373714+0000", 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2904000000000002e-05 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373721+0000", 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0609999999999998e-06 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373726+0000", 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2870000000000004e-06 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.380581+0000", 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068548410000000004 2024-04-26T12:10:17.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.380661+0000", 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0215000000000004e-05 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.380783+0000", 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121476 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382557+0000", 2024-04-26T12:10:17.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017738140000000001 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386200+0000", 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036437930000000002 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386257+0000", 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6645999999999999e-05 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386311+0000", 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3780999999999999e-05 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:162 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.208189808999997, 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013269345, 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 162 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373734+0000", 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2129999999999998e-06 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373737+0000", 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373740+0000", 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6369999999999999e-06 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381599+0000", 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078590029999999998 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381657+0000", 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7948000000000002e-05 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381742+0000", 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5070999999999999e-05 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386318+0000", 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004576508 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386923+0000", 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000604369 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386965+0000", 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1708000000000001e-05 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387001+0000", 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6709999999999999e-05 2024-04-26T12:10:17.596 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:163 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.208179176000002, 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013403248, 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:17.597 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 163 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373742+0000", 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373745+0000", 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373748+0000", 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:10:17.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373750+0000", 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.463e-06 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382013+0000", 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082630099999999995 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382092+0000", 2024-04-26T12:10:17.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8720999999999994e-05 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382214+0000", 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012222200000000001 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387012+0000", 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047978430000000004 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387055+0000", 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3129e-05 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387105+0000", 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9372000000000001e-05 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387146+0000", 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1205999999999998e-05 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:164 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.208163417999998, 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013509999999999999, 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 164 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373788+0000", 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0052999999999998e-05 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373796+0000", 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2290000000000003e-06 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373800+0000", 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3189999999999999e-06 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382597+0000", 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087972889999999998 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382675+0000", 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8343999999999994e-05 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382796+0000", 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120531 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387186+0000", 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043906459999999998 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387194+0000", 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3069999999999997e-06 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387233+0000", 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9804e-05 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387268+0000", 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4867999999999999e-05 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.608 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:165 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.208118867000003, 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013631885999999999, 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 165 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373805+0000", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1110000000000002e-06 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373810+0000", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373813+0000", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4419999999999998e-06 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386360+0000", 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012547106000000001 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386446+0000", 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386582+0000", 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136236 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387277+0000", 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694698 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387391+0000", 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113725 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387416+0000", 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5188999999999999e-05 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387435+0000", 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8717000000000001e-05 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212694317, 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012500778000000001, 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369227+0000", 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369232+0000", 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3870000000000003e-06 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369240+0000", 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8019999999999992e-06 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369246+0000", 2024-04-26T12:10:17.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3749999999999999e-06 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369890+0000", 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064422500000000001 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370040+0000", 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014978800000000001 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370870+0000", 2024-04-26T12:10:17.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082954299999999997 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.377571+0000", 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067017259999999999 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381629+0000", 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040575139999999999 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381684+0000", 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5229999999999998e-05 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381728+0000", 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3964999999999997e-05 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:17.619 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212667635999999, 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012625117999999999, 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369254+0000", 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369286+0000", 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2366000000000001e-05 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369303+0000", 2024-04-26T12:10:17.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6663999999999998e-05 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369309+0000", 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.764e-06 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.371411+0000", 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00210158 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.372222+0000", 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000811373 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.372380+0000", 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015714 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378975+0000", 2024-04-26T12:10:17.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065955609999999998 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381814+0000", 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002838967 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381848+0000", 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.362e-05 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381879+0000", 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1538999999999997e-05 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212604254999999, 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012714021000000001, 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.625 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369322+0000", 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369328+0000", 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8839999999999997e-06 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369334+0000", 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9150000000000001e-06 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376462+0000", 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071274550000000004 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376544+0000", 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1843999999999998e-05 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376714+0000", 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017050400000000001 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380051+0000", 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033371189999999999 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381943+0000", 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018913689999999999 2024-04-26T12:10:17.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381989+0000", 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6717e-05 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382031+0000", 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2126999999999998e-05 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212582181999998, 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013541195000000001, 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369339+0000", 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369343+0000", 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369350+0000", 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1570000000000003e-06 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369356+0000", 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380245+0000", 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010889272 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380388+0000", 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014244799999999999 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380794+0000", 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000406272 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382778+0000", 2024-04-26T12:10:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019838590000000001 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382829+0000", 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1394000000000003e-05 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382860+0000", 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0555999999999997e-05 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382881+0000", 2024-04-26T12:10:17.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.103e-05 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212561176000001, 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013570262, 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369360+0000", 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369363+0000", 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.326e-06 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369371+0000", 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369376+0000", 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-04-26T12:10:17.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381153+0000", 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011776371000000001 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381240+0000", 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7603999999999997e-05 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381360+0000", 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011987 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382818+0000", 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014577539999999999 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382888+0000", 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0110999999999993e-05 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382912+0000", 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4270999999999999e-05 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382931+0000", 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8471e-05 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:17.641 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212540384, 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014056391999999999, 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369385+0000", 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7639999999999999e-06 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369391+0000", 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-04-26T12:10:17.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369396+0000", 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.31e-06 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382075+0000", 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012678952 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382146+0000", 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0817999999999999e-05 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382232+0000", 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6238999999999999e-05 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383023+0000", 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00079041699999999996 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383384+0000", 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036165299999999997 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383418+0000", 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4171000000000002e-05 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383438+0000", 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.646 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212504823, 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015550154, 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369416+0000", 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369429+0000", 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2826000000000001e-05 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369438+0000", 2024-04-26T12:10:17.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8349999999999993e-06 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369445+0000", 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5869999999999998e-06 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382426+0000", 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012981670000000001 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382511+0000", 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4915999999999998e-05 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382605+0000", 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4176000000000001e-05 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383461+0000", 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085609599999999998 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384909+0000", 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00144746 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384941+0000", 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2209999999999998e-05 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384967+0000", 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.599e-05 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212415158999999, 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012938036999999999, 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:17.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369506+0000", 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369517+0000", 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1212999999999999e-05 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369524+0000", 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0960000000000003e-06 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369534+0000", 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8390000000000002e-06 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374150+0000", 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046155700000000003 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374820+0000", 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067048499999999996 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374962+0000", 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141936 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378959+0000", 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039968160000000003 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382351+0000", 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003391813 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382388+0000", 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7075e-05 2024-04-26T12:10:17.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382445+0000", 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6560000000000001e-05 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212368918999999, 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013278130000000001, 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.657 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369552+0000", 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369556+0000", 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0559999999999998e-06 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369566+0000", 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0131e-05 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369572+0000", 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1319999999999999e-06 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375385+0000", 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058125659999999999 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375915+0000", 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000529898 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376132+0000", 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000217247 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.379294+0000", 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031621560000000002 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382748+0000", 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034539699999999998 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382796+0000", 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7772999999999998e-05 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382831+0000", 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4848999999999998e-05 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.662 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369730+0000", 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.212192123000001, 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012289147, 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369730+0000", 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369730+0000", 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369729+0000", 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369733+0000", 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3560000000000001e-06 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369739+0000", 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3910000000000003e-06 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369762+0000", 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3470999999999999e-05 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.370911+0000", 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011481639999999999 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.371039+0000", 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012849199999999999 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.371189+0000", 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015031500000000001 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375914+0000", 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047246390000000001 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381921+0000", 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006006572 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381977+0000", 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6737999999999998e-05 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382019+0000", 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1446999999999998e-05 2024-04-26T12:10:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:8884 5.2 5:473218bb:::benchmark_data_smithi045_43640_object8883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:14.250229+0000", 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.331692688, 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013457143, 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.668 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8884 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250229+0000", 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250229+0000", 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250228+0000", 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250282+0000", 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3291000000000002e-05 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250291+0000", 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6220000000000004e-06 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250297+0000", 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2380000000000002e-06 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250327+0000", 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9408999999999999e-05 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250411+0000", 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4473000000000003e-05 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250493+0000", 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2094000000000004e-05 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251178+0000", 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068480500000000003 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.263600+0000", 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012422290000000001 2024-04-26T12:10:17.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.263648+0000", 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7874000000000003e-05 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.263686+0000", 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7799000000000002e-05 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.673 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:8891 5.7 5:e9c6fa8a:::benchmark_data_smithi045_43640_object8890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.3307795640000002, 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013024897000000001, 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8891 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:17.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251334+0000", 2024-04-26T12:10:17.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019247900000000001 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251341+0000", 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.396e-06 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251349+0000", 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.909e-06 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251378+0000", 2024-04-26T12:10:17.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.866e-05 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251496+0000", 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118078 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251638+0000", 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014185900000000001 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.252909+0000", 2024-04-26T12:10:17.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012713329999999999 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264117+0000", 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011208174 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264146+0000", 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8140000000000002e-05 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264167+0000", 2024-04-26T12:10:17.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1497000000000001e-05 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:8896 5.1 5:8ae0dfb6:::benchmark_data_smithi045_43640_object8895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.330564426, 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012812172, 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8896 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251475+0000", 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011808500000000001 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251484+0000", 2024-04-26T12:10:17.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251487+0000", 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7280000000000001e-06 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251518+0000", 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0651000000000002e-05 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251607+0000", 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9195000000000002e-05 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251691+0000", 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4048000000000006e-05 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.252577+0000", 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088533800000000005 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264110+0000", 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011533692 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264145+0000", 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4898999999999999e-05 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264169+0000", 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:10:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:18437 5.2 5:43b095c9:::benchmark_data_smithi045_43640_object18436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.82069633500000005, 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013489296, 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 18437 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761332+0000", 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010694199999999999 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761340+0000", 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0010000000000001e-06 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761345+0000", 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761383+0000", 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8077999999999997e-05 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761505+0000", 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121848 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761637+0000", 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131536 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.764883+0000", 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003246292 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774623+0000", 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097397160000000007 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774681+0000", 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8740999999999999e-05 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774715+0000", 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3297999999999999e-05 2024-04-26T12:10:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:18441 5.7 5:e6d96e0a:::benchmark_data_smithi045_43640_object18440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.82041544200000005, 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013210398, 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 18441 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761543+0000", 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7670999999999999e-05 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761551+0000", 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5129999999999999e-06 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761558+0000", 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.34e-06 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761730+0000", 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017144999999999999 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761801+0000", 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1165000000000001e-05 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761878+0000", 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6716000000000002e-05 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.765725+0000", 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003847301 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774625+0000", 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089006410000000008 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774678+0000", 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2859999999999999e-05 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774717+0000", 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8362000000000003e-05 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:17.697 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:17.698 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 5 16 21416 21400 267.459 221.5 0.00534925 0.00373465 2024-04-26T12:10:17.699 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:17.699 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:17.697+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.799 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:17.798+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22216 5.4 5:2ee369f3:::benchmark_data_smithi045_43640_object22215:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.873907+0000", 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0025972679999999998, 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026162500000000001, 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.878 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22216 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.873907+0000", 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.873907+0000", 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.873906+0000", 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874041+0000", 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013474900000000001 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874048+0000", 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4039999999999998e-06 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874054+0000", 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.045e-06 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874076+0000", 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2096e-05 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874151+0000", 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5549999999999993e-05 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874236+0000", 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4724999999999999e-05 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.875152+0000", 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00091566399999999995 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.882 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22217 5.b 5:dfa0b96e:::benchmark_data_smithi045_43640_object22216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.874060+0000", 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0024445109999999999, 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002517353, 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22217 2024-04-26T12:10:17.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874060+0000", 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874060+0000", 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874059+0000", 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874122+0000", 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2998999999999998e-05 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874127+0000", 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8690000000000003e-06 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874131+0000", 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.811e-06 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874162+0000", 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1432e-05 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874284+0000", 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012175700000000001 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874368+0000", 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3777999999999996e-05 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.875766+0000", 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001398102 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22219 5.0 5:0d4f9ede:::benchmark_data_smithi045_43640_object22218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.874141+0000", 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0023635739999999998, 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024833849999999998, 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22219 2024-04-26T12:10:17.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.889 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874141+0000", 2024-04-26T12:10:17.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874141+0000", 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874140+0000", 2024-04-26T12:10:17.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874194+0000", 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3285999999999998e-05 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874200+0000", 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.533e-06 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874206+0000", 2024-04-26T12:10:17.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874234+0000", 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8177000000000001e-05 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874323+0000", 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8980000000000005e-05 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874407+0000", 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3894999999999996e-05 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.875388+0000", 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00098087000000000001 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22220 5.b 5:d6b61dfd:::benchmark_data_smithi045_43640_object22219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.874214+0000", 2024-04-26T12:10:17.893 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0022906950000000001, 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002456279, 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22220 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874214+0000", 2024-04-26T12:10:17.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874214+0000", 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874213+0000", 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874245+0000", 2024-04-26T12:10:17.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1860000000000003e-05 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874252+0000", 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1130000000000003e-06 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.874259+0000", 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1770000000000001e-06 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.875071+0000", 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00081203799999999995 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.875174+0000", 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102882 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.875254+0000", 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0076999999999999e-05 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876018+0000", 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00076393700000000001 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:22204 5.4 e21/17)", 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.876682+0000", 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998226, 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9255000000000002e-05, 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876682+0000", 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876682+0000", 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876681+0000", 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876685+0000", 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5829999999999998e-06 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876692+0000", 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6620000000000005e-06 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876697+0000", 2024-04-26T12:10:17.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0799999999999996e-06 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876734+0000", 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6619999999999998e-05 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22204 5.4 5:231a144d:::benchmark_data_smithi045_43640_object22203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.869118+0000", 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0073861880000000001, 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0076664990000000002, 2024-04-26T12:10:17.901 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22204 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.869118+0000", 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.869118+0000", 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.869118+0000", 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.869206+0000", 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7865e-05 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.869215+0000", 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8970000000000003e-06 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.869223+0000", 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3139999999999998e-06 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.870278+0000", 2024-04-26T12:10:17.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010550970000000001 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.870415+0000", 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013739500000000001 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.870565+0000", 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015010800000000001 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871590+0000", 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001024126 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.876775+0000", 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0051851290000000001 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22210 5.e 5:7c70daa4:::benchmark_data_smithi045_43640_object22209:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.871906+0000", 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0045988599999999998, 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0049717340000000002, 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.907 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22210 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871906+0000", 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871906+0000", 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871905+0000", 2024-04-26T12:10:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871985+0000", 2024-04-26T12:10:17.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9771000000000006e-05 2024-04-26T12:10:17.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871994+0000", 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0049999999999993e-06 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.871999+0000", 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:10:17.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872026+0000", 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872111+0000", 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4790999999999995e-05 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872188+0000", 2024-04-26T12:10:17.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7100000000000004e-05 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.873523+0000", 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001334642 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22213 5.e 5:7c02c718:::benchmark_data_smithi045_43640_object22212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.872150+0000", 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0043541450000000002, 2024-04-26T12:10:17.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0047936940000000003, 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22213 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872150+0000", 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872150+0000", 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872150+0000", 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872233+0000", 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3039000000000002e-05 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872240+0000", 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6059999999999997e-06 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872247+0000", 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.331e-06 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872811+0000", 2024-04-26T12:10:17.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00056384200000000005 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872900+0000", 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9184999999999994e-05 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872978+0000", 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8343999999999994e-05 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.873782+0000", 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00080374199999999998 2024-04-26T12:10:17.919 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22214 5.0 5:0423ff86:::benchmark_data_smithi045_43640_object22213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.872254+0000", 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0042508160000000001, 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0047372229999999996, 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22214 2024-04-26T12:10:17.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872254+0000", 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872254+0000", 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872253+0000", 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:17.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872283+0000", 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9918000000000001e-05 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872288+0000", 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3720000000000004e-06 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872292+0000", 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5999999999999998e-06 2024-04-26T12:10:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872329+0000", 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7663000000000002e-05 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872407+0000", 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7855000000000006e-05 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.872485+0000", 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7503999999999995e-05 2024-04-26T12:10:17.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.873574+0000", 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010895379999999999 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 9 2024-04-26T12:10:17.924 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:17.925 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:17.924+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:17.926 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:18.027 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:18.026+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:18.090 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:18.090 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:18.090 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:18.090 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:18.090 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:18.104 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:18.127 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:18.126+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:18.229 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:18.228+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:18.279 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 28.908702402999999, 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013096059, 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366763+0000", 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4530000000000001e-06 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366772+0000", 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.251e-06 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366783+0000", 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0886999999999999e-05 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370530+0000", 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037465969999999999 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370615+0000", 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5364999999999993e-05 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370790+0000", 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017513300000000001 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373719+0000", 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002928614 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379758+0000", 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060387740000000002 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379803+0000", 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5123999999999997e-05 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379854+0000", 2024-04-26T12:10:18.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1637e-05 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 28.908119504999998, 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012775111, 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367340+0000", 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367348+0000", 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.311e-06 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367368+0000", 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0517999999999999e-05 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367378+0000", 2024-04-26T12:10:18.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8770000000000005e-06 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371711+0000", 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00433287 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371850+0000", 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013893099999999999 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371990+0000", 2024-04-26T12:10:18.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000140288 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373945+0000", 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019548970000000001 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380017+0000", 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060725060000000001 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380069+0000", 2024-04-26T12:10:18.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1909000000000001e-05 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380116+0000", 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6941999999999999e-05 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:18.290 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 28.906962303, 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012850874999999999, 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:18.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368504+0000", 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368514+0000", 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0190000000000001e-05 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368523+0000", 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9509999999999995e-06 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.372499+0000", 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039758789999999999 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373036+0000", 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00053641300000000002 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373189+0000", 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000153029 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.374345+0000", 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001156453 2024-04-26T12:10:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381242+0000", 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068968930000000003 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381300+0000", 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8038000000000002e-05 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381349+0000", 2024-04-26T12:10:18.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9258000000000002e-05 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 28.90687453, 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012764034, 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368585+0000", 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368591+0000", 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368597+0000", 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7460000000000003e-06 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368602+0000", 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0799999999999996e-06 2024-04-26T12:10:18.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373059+0000", 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044562059999999999 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373178+0000", 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011930900000000001 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373318+0000", 2024-04-26T12:10:18.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014009499999999999 2024-04-26T12:10:18.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.374382+0000", 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001064382 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381272+0000", 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068900719999999997 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381312+0000", 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9266e-05 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381350+0000", 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8510000000000002e-05 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8885 5.0 5:05f43a42:::benchmark_data_smithi045_43640_object8884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0250561490000001, 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013442571, 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8885 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250404+0000", 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250440+0000", 2024-04-26T12:10:18.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6013000000000002e-05 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250450+0000", 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9969999999999993e-06 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250456+0000", 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9009999999999999e-06 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250484+0000", 2024-04-26T12:10:18.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8342000000000001e-05 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250567+0000", 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2417999999999996e-05 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250649+0000", 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2315e-05 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251244+0000", 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00059499200000000003 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263693+0000", 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012449276 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263774+0000", 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0716000000000004e-05 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263847+0000", 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3318999999999994e-05 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8887 5.4 5:2f729b2c:::benchmark_data_smithi045_43640_object8886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0245493950000002, 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013197943, 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.309 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8887 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250910+0000", 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251023+0000", 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112483 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251033+0000", 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0395e-05 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251041+0000", 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4150000000000002e-06 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251082+0000", 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0892000000000001e-05 2024-04-26T12:10:18.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251182+0000", 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100005 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251313+0000", 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013093999999999999 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252305+0000", 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00099206800000000003 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264059+0000", 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011754114 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264088+0000", 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9246000000000001e-05 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264109+0000", 2024-04-26T12:10:18.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1291e-05 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8892 5.8 5:1ec4722e:::benchmark_data_smithi045_43640_object8891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251257+0000", 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0242037350000004, 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012979917000000001, 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.315 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8892 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251257+0000", 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251257+0000", 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251256+0000", 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251392+0000", 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013522100000000001 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251398+0000", 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.959e-06 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251401+0000", 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7120000000000002e-06 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251429+0000", 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7492e-05 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251528+0000", 2024-04-26T12:10:18.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9394000000000004e-05 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251657+0000", 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012882900000000001 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252671+0000", 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010136590000000001 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264178+0000", 2024-04-26T12:10:18.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011507631000000001 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264207+0000", 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8381000000000002e-05 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264237+0000", 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0303000000000001e-05 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8894 5.b 5:d28e84bb:::benchmark_data_smithi045_43640_object8893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0240539310000001, 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013316091, 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8894 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251406+0000", 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251547+0000", 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141116 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251556+0000", 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3089999999999996e-06 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251563+0000", 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5399999999999998e-06 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251601+0000", 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7861999999999998e-05 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251717+0000", 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000115507 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251848+0000", 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131252 2024-04-26T12:10:18.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253099+0000", 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001251252 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264673+0000", 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011573603 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264703+0000", 2024-04-26T12:10:18.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0605999999999998e-05 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264723+0000", 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9544000000000001e-05 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8895 5.8 5:1a1d64bc:::benchmark_data_smithi045_43640_object8894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.023887652, 2024-04-26T12:10:18.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012735948, 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8895 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251635+0000", 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2781999999999996e-05 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251643+0000", 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5669999999999997e-06 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251650+0000", 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252079+0000", 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00042977500000000002 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252216+0000", 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013720200000000001 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252318+0000", 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000101742 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252997+0000", 2024-04-26T12:10:18.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00067903799999999997 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264258+0000", 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011260859999999999 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264281+0000", 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.266e-05 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264309+0000", 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8262000000000001e-05 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8899 5.b 5:d89ec7e6:::benchmark_data_smithi045_43640_object8898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.252324+0000", 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0231365070000003, 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012493227000000001, 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8899 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252324+0000", 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252324+0000", 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252324+0000", 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252408+0000", 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4252000000000006e-05 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252416+0000", 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0970000000000006e-06 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252422+0000", 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6869999999999999e-06 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252466+0000", 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4746000000000002e-05 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252560+0000", 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4005000000000005e-05 2024-04-26T12:10:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252685+0000", 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012496 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253606+0000", 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00092085699999999997 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264755+0000", 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0111492 2024-04-26T12:10:18.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264785+0000", 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9819e-05 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264817+0000", 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2301999999999997e-05 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.337 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8900 5.b 5:d33b62db:::benchmark_data_smithi045_43640_object8899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.252959+0000", 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0225018849999996, 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012010887, 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8900 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252959+0000", 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252959+0000", 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252958+0000", 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253058+0000", 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9959999999999998e-05 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253071+0000", 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3098000000000001e-05 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253078+0000", 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.725e-06 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253115+0000", 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6715999999999999e-05 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253201+0000", 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5838e-05 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253282+0000", 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1268999999999997e-05 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253764+0000", 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00048226999999999998 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264894+0000", 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011130327000000001 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264936+0000", 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2036999999999997e-05 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264970+0000", 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3287999999999997e-05 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18435 5.b 5:d1429ed2:::benchmark_data_smithi045_43640_object18434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.51431775, 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013538150000000001, 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18435 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761142+0000", 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761199+0000", 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6650999999999997e-05 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761206+0000", 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.391e-06 2024-04-26T12:10:18.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761211+0000", 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8380000000000001e-06 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761236+0000", 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4709999999999999e-05 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761314+0000", 2024-04-26T12:10:18.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8343000000000005e-05 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761398+0000", 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3653999999999996e-05 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762811+0000", 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014135840000000001 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774484+0000", 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011672561 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774626+0000", 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014174500000000001 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774681+0000", 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5495000000000003e-05 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18436 5.8 5:171915a6:::benchmark_data_smithi045_43640_object18435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.514243972, 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013344784, 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18436 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.349 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761216+0000", 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761311+0000", 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4912000000000002e-05 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761317+0000", 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5500000000000002e-06 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761321+0000", 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6559999999999998e-06 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761355+0000", 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4289999999999999e-05 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761462+0000", 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106743 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761550+0000", 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8185999999999999e-05 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762740+0000", 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011899250000000001 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774429+0000", 2024-04-26T12:10:18.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011689643 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774508+0000", 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8405999999999994e-05 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774562+0000", 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3811999999999999e-05 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.354 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18443 5.e 5:7a1f377a:::benchmark_data_smithi045_43640_object18442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.5137898079999998, 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013395112000000001, 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18443 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.355 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761670+0000", 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761698+0000", 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7858e-05 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761716+0000", 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761722+0000", 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0140000000000004e-06 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761764+0000", 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2364999999999998e-05 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761883+0000", 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119024 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762031+0000", 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014787000000000001 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763327+0000", 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012958309999999999 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775010+0000", 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011683037 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775034+0000", 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4496999999999999e-05 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775066+0000", 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1890999999999997e-05 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.360 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18445 5.4 5:2b1a26ab:::benchmark_data_smithi045_43640_object18444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.512607276, 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014248856000000001, 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18445 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762903+0000", 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0436999999999998e-05 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762912+0000", 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5790000000000004e-06 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762919+0000", 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:18.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762960+0000", 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1046e-05 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763044+0000", 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3788999999999993e-05 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763132+0000", 2024-04-26T12:10:18.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8162000000000001e-05 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763995+0000", 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00086267500000000003 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777026+0000", 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013031093000000001 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777068+0000", 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1953000000000003e-05 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777102+0000", 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4746000000000002e-05 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:21456 5.d 5:bd08ac67:::benchmark_data_smithi045_43640_object21455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.616220+0000", 2024-04-26T12:10:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.65924080799999996, 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012852683, 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 21456 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616220+0000", 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616220+0000", 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616219+0000", 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616356+0000", 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013698399999999999 2024-04-26T12:10:18.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616364+0000", 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1269999999999997e-06 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616370+0000", 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.617112+0000", 2024-04-26T12:10:18.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00074222899999999996 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.617230+0000", 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011794999999999999 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.617366+0000", 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013623199999999999 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.618781+0000", 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014152170000000001 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.628984+0000", 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010203017999999999 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.629034+0000", 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.629073+0000", 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8702999999999999e-05 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22165 5.0 5:052deb84:::benchmark_data_smithi045_43640_object22164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.42391844000000001, 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013303288999999999, 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22165 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851674+0000", 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000132664 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851683+0000", 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2930000000000001e-06 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851690+0000", 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3699999999999997e-06 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852246+0000", 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00055546700000000003 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852392+0000", 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014629700000000001 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852555+0000", 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016261699999999999 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854109+0000", 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001554656 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864757+0000", 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010647439999999999 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864802+0000", 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5751999999999998e-05 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864846+0000", 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3238999999999997e-05 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22167 5.8 5:13422a89:::benchmark_data_smithi045_43640_object22166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.377 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.42376472799999998, 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01318099, 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22167 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851695+0000", 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851813+0000", 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117843 2024-04-26T12:10:18.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851821+0000", 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.661e-06 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851827+0000", 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1789999999999996e-06 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852237+0000", 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00041010299999999999 2024-04-26T12:10:18.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852404+0000", 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000167195 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852582+0000", 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017714099999999999 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854116+0000", 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001534856 2024-04-26T12:10:18.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864794+0000", 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010677246 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864841+0000", 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7003999999999999e-05 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864877+0000", 2024-04-26T12:10:18.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6338999999999999e-05 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22170 5.4 5:2e544594:::benchmark_data_smithi045_43640_object22169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.852477+0000", 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.42298329400000001, 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01239956, 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22170 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852477+0000", 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852477+0000", 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852477+0000", 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.853269+0000", 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00079276399999999995 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.853285+0000", 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.6141e-05 2024-04-26T12:10:18.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.853301+0000", 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5116000000000001e-05 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.853352+0000", 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.853476+0000", 2024-04-26T12:10:18.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012420899999999999 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.853569+0000", 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3108000000000004e-05 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854548+0000", 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00097858699999999995 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864790+0000", 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010242174999999999 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864843+0000", 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3531e-05 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864877+0000", 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3674999999999999e-05 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22171 5.e 5:7b7def9e:::benchmark_data_smithi045_43640_object22170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.854032+0000", 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.42142900700000002, 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012594522, 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22171 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:18.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854032+0000", 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854032+0000", 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854031+0000", 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854135+0000", 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104557 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854147+0000", 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1985e-05 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854156+0000", 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1710000000000002e-06 2024-04-26T12:10:18.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854195+0000", 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9150000000000003e-05 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854299+0000", 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103992 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854383+0000", 2024-04-26T12:10:18.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3968999999999995e-05 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.855475+0000", 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010926849999999999 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.866519+0000", 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011043499 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.866575+0000", 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:10:18.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.866626+0000", 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1190999999999998e-05 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:18.394 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:18.396 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:18.394+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:18.396 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:18.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:10:18.496 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:18.495+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:18.588 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:18.588 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:18.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.589 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24417 5.a 5:58fae479:::benchmark_data_smithi045_43640_object24416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.589 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.582979+0000", 2024-04-26T12:10:18.589 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003450902, 2024-04-26T12:10:18.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003475161, 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24417 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.582979+0000", 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.582979+0000", 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.582979+0000", 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583098+0000", 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000119815 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583106+0000", 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583111+0000", 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3349999999999997e-06 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583204+0000", 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3222999999999998e-05 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583322+0000", 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000117019 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583448+0000", 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012659699999999999 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24419 5.5 5:aa476ec1:::benchmark_data_smithi045_43640_object24418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583118+0000", 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0033121800000000001, 2024-04-26T12:10:18.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033906420000000001, 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24419 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583118+0000", 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583118+0000", 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583118+0000", 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583147+0000", 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9662000000000002e-05 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583152+0000", 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8459999999999999e-06 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583156+0000", 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4939999999999999e-06 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583189+0000", 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.324e-05 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583320+0000", 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013149400000000001 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583428+0000", 2024-04-26T12:10:18.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010801 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585293+0000", 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001864678 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24420 5.c 5:3f6bb8d4:::benchmark_data_smithi045_43640_object24419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583166+0000", 2024-04-26T12:10:18.599 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0032640170000000001, 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033897699999999998, 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24420 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.600 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583166+0000", 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583166+0000", 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583166+0000", 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583274+0000", 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108675 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583284+0000", 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5729999999999997e-06 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583291+0000", 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2180000000000002e-06 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583328+0000", 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6699999999999998e-05 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583446+0000", 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118644 2024-04-26T12:10:18.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583628+0000", 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00018177100000000001 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586058+0000", 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024298990000000001 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.604 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24422 5.a 5:582dd260:::benchmark_data_smithi045_43640_object24421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583302+0000", 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031284450000000001, 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033015969999999999, 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.605 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24422 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583302+0000", 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583302+0000", 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583301+0000", 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583381+0000", 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9472000000000001e-05 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583389+0000", 2024-04-26T12:10:18.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583395+0000", 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.319e-06 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584301+0000", 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000905951 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584406+0000", 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000105103 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584570+0000", 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000164201 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24426 5.a 5.3b4ebc9a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583446+0000", 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029843389999999999, 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031970879999999998, 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24426 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.610 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583446+0000", 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583446+0000", 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583445+0000", 2024-04-26T12:10:18.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583567+0000", 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122297 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583578+0000", 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0515e-05 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583586+0000", 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5680000000000002e-06 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24418 5.7 e21/17 5:e7ab1b9b:::benchmark_data_smithi045_43640_object24417:head v 21'1532, mlcod=21'1530)", 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583529+0000", 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029007859999999998, 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031448159999999999, 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.613 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583529+0000", 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583529+0000", 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583529+0000", 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583621+0000", 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1692000000000002e-05 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583629+0000", 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.96e-06 2024-04-26T12:10:18.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583634+0000", 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583668+0000", 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3312999999999998e-05 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583687+0000", 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9698e-05 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24421 5.e e21/17 5:75d61d61:::benchmark_data_smithi045_43640_object24420:head v 21'1534, mlcod=21'1532)", 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583890+0000", 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0025404189999999999, 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028172420000000002, 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.617 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583890+0000", 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583890+0000", 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.618 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583889+0000", 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583930+0000", 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0905000000000002e-05 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583941+0000", 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1296e-05 2024-04-26T12:10:18.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583949+0000", 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9580000000000007e-06 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584004+0000", 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4163999999999998e-05 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584043+0000", 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9558000000000003e-05 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24416 5.8 e21/17 5:1580f352:::benchmark_data_smithi045_43640_object24415:head v 21'1493, mlcod=21'1491)", 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.583980+0000", 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0024501940000000002, 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027707729999999998, 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.621 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583980+0000", 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583980+0000", 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.583980+0000", 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584014+0000", 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4226000000000001e-05 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584026+0000", 2024-04-26T12:10:18.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2303999999999999e-05 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584032+0000", 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.502e-06 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584096+0000", 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4552000000000001e-05 2024-04-26T12:10:18.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584113+0000", 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7277000000000001e-05 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24423 5.4 e21/17 5:20ace1a8:::benchmark_data_smithi045_43640_object24422:head v 21'1612, mlcod=21'1610)", 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.584071+0000", 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023587740000000001, 2024-04-26T12:10:18.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027132089999999998, 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584071+0000", 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584071+0000", 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584071+0000", 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584104+0000", 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3337000000000003e-05 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584112+0000", 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0010000000000001e-06 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584118+0000", 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584508+0000", 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00038941399999999998 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584524+0000", 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6555e-05 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24424 5.0 e21/17 5:0e6e41c3:::benchmark_data_smithi045_43640_object24423:head v 21'1545, mlcod=21'1542)", 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.584127+0000", 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023033369999999999, 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026905760000000001, 2024-04-26T12:10:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584127+0000", 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584127+0000", 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584126+0000", 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584156+0000", 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584163+0000", 2024-04-26T12:10:18.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2250000000000003e-06 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584168+0000", 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584502+0000", 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00033361399999999998 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.584519+0000", 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7099999999999999e-05 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24425 5.2 e21/17 5:4f6963ce:::benchmark_data_smithi045_43640_object24424:head v 21'1499, mlcod=21'1497)", 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.585180+0000", 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001250134, 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016705349999999999, 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.633 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585180+0000", 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585180+0000", 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585180+0000", 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585205+0000", 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5686000000000001e-05 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585212+0000", 2024-04-26T12:10:18.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7329999999999997e-06 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585217+0000", 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7079999999999996e-06 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586221+0000", 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010047929999999999 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586239+0000", 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7405e-05 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:24412 5.3 e21/17)", 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.585226+0000", 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001204643, 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016568329999999999, 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:18.637 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585226+0000", 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585226+0000", 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585225+0000", 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585227+0000", 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7060000000000001e-06 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.639 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585231+0000", 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.501e-06 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585233+0000", 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7240000000000001e-06 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.640 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24427 5.c 5:394775be:::benchmark_data_smithi045_43640_object24426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.585263+0000", 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0011669269999999999, 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016492740000000001, 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24427 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585263+0000", 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585263+0000", 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585263+0000", 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585282+0000", 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9857999999999999e-05 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585290+0000", 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8879999999999997e-06 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585295+0000", 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586083+0000", 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00078846500000000002 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586203+0000", 2024-04-26T12:10:18.644 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011987800000000001 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586342+0000", 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013895800000000001 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:24417 5.a e21/17)", 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.585682+0000", 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00074827699999999999, 2024-04-26T12:10:18.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012739909999999999, 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585682+0000", 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585682+0000", 2024-04-26T12:10:18.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585681+0000", 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585686+0000", 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6299999999999997e-06 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585698+0000", 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.187e-05 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585705+0000", 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2629999999999997e-06 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24428 5.a 5.a464251a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.585613+0000", 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000816758, 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013759530000000001, 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24428 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.649 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585613+0000", 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585613+0000", 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585613+0000", 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585704+0000", 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0797999999999994e-05 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585709+0000", 2024-04-26T12:10:18.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585713+0000", 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2549999999999999e-06 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:24422 5.a e21/17)", 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.585907+0000", 2024-04-26T12:10:18.652 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00052283400000000002, 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001147136, 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585907+0000", 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585907+0000", 2024-04-26T12:10:18.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585907+0000", 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585911+0000", 2024-04-26T12:10:18.654 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3170000000000003e-06 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585922+0000", 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0879999999999999e-05 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.585928+0000", 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3230000000000003e-06 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:24429 5.e e21/17 5:72ad1cc0:::benchmark_data_smithi045_43640_object24428:head v 21'1535, mlcod=21'1532)", 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.586923+0000", 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.999507, 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000189944, 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586923+0000", 2024-04-26T12:10:18.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586923+0000", 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586923+0000", 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586991+0000", 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7861999999999995e-05 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.586999+0000", 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0600000000000008e-06 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.587003+0000", 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6059999999999996e-06 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.587033+0000", 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9371000000000001e-05 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.587043+0000", 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0726e-05 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.659 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:24412 5.3 5:c0ab53bd:::benchmark_data_smithi045_43640_object24411:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.580337+0000", 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.006093617, 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0068483299999999997, 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:18.660 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 24412 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.580337+0000", 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.661 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.580337+0000", 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.580336+0000", 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:18.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.580462+0000", 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012652799999999999 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.580471+0000", 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1559999999999995e-06 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.580477+0000", 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8369999999999999e-06 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.582634+0000", 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021567050000000001 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.582790+0000", 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015566399999999999 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.582961+0000", 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017082100000000001 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:18.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.587000+0000", 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040394949999999997 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 18 2024-04-26T12:10:18.665 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:18.666 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 6 16 24483 24467 254.828 191.688 0.00486535 0.0039195 2024-04-26T12:10:18.667 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:18.665+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:18.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:18.692 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:18.767 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:18.766+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:18.865 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:18.867 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:18.866+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:18.889 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:18.899 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:18.899 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:18.899 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:18.899 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:18.899 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:18.913 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:18.917 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:18.935 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:10:18.968 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:18.967+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:19.068 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:19.068+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:19.136 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:19.136 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:19.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:19.196 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:19.195+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:19.270 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:19.269+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:19.327 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:19.327 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:19.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:19.371 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:19.370+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:19.472 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:19.471+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:19.562 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:19.563 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:19.573 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:19.572+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:19.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:19.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 7 16 27615 27599 246.386 195.75 0.00432206 0.00405486 2024-04-26T12:10:19.674 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:19.673+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:19.758 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:19.758 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:19.773 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:19.774 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:19.773+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:19.874 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:19.873+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:19.944 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:19.944 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:19.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:19.976 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:19.975+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.077 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.076+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.174 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:20.174 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:20.178 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.177+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.190 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:20.278 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:20.278+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:20.368 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:20.368 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:20.380 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.379+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:20.481 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.480+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.567 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:20.567 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:20.583 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:20.583 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.581+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.603 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 8 16 30758 30742 240.141 196.438 0.00789502 0.00415974 2024-04-26T12:10:20.683 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:20.683+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:20.784 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:20.783+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:20.808 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:20.809 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:20.824 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:20.885 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.884+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:20.930 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:20.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:10:20.986 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:20.985+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:21.010 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:21.010 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:21.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:21.086 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:21.085+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:21.130 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:21.154 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:21.177 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:21.187 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:21.186+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32489 5.2 5:4439df31:::benchmark_data_smithi045_43640_object32488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.201756+0000", 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0056341359999999997, 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056626710000000002, 2024-04-26T12:10:21.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32489 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.201756+0000", 2024-04-26T12:10:21.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.201756+0000", 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.201756+0000", 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.201869+0000", 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113801 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.201879+0000", 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1390000000000001e-06 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.201884+0000", 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5389999999999998e-06 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.203070+0000", 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011860589999999999 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.203167+0000", 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7027999999999993e-05 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.203261+0000", 2024-04-26T12:10:21.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3881000000000005e-05 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204703+0000", 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001441735 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32494 5.9 5:974d563b:::benchmark_data_smithi045_43640_object32493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.202454+0000", 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0049360089999999999, 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050335889999999998, 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32494 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.202454+0000", 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.202454+0000", 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.202454+0000", 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.202527+0000", 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3274000000000004e-05 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.202534+0000", 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0469999999999996e-06 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.202544+0000", 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.203329+0000", 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078507000000000002 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.203485+0000", 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015553799999999999 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.203633+0000", 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148744 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206353+0000", 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027194089999999999 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207417+0000", 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001064412 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207454+0000", 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6588999999999998e-05 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207493+0000", 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9091999999999998e-05 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32497 5.9 5:97597198:::benchmark_data_smithi045_43640_object32496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.204396+0000", 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0029946790000000001, 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751729999999999, 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32497 2024-04-26T12:10:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204396+0000", 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204396+0000", 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204395+0000", 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204483+0000", 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8664000000000004e-05 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204498+0000", 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4212e-05 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204506+0000", 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6440000000000006e-06 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204919+0000", 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041319399999999997 2024-04-26T12:10:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205030+0000", 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110776 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205162+0000", 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013221899999999999 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32498 5.7 5:ee538a76:::benchmark_data_smithi045_43640_object32497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.204644+0000", 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.002746479, 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029799969999999999, 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32498 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204644+0000", 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204644+0000", 2024-04-26T12:10:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204643+0000", 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204712+0000", 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9387000000000005e-05 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204724+0000", 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1832e-05 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204732+0000", 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8269999999999998e-06 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204788+0000", 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5775e-05 2024-04-26T12:10:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204881+0000", 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3535999999999993e-05 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205008+0000", 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012615599999999999 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32499 5.2 5:4c853345:::benchmark_data_smithi045_43640_object32498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.204741+0000", 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0026491510000000002, 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002934084, 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32499 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204741+0000", 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204741+0000", 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204741+0000", 2024-04-26T12:10:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204778+0000", 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7224999999999997e-05 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204786+0000", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6279999999999994e-06 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204800+0000", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3385e-05 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204828+0000", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.851e-05 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204908+0000", 2024-04-26T12:10:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0060000000000003e-05 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205040+0000", 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013144599999999999 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32500 5.f 5:f286eb13:::benchmark_data_smithi045_43640_object32499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.204810+0000", 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0025803110000000001, 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029450019999999999, 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32500 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204810+0000", 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204810+0000", 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204809+0000", 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204859+0000", 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9750000000000003e-05 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204869+0000", 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9080000000000007e-06 2024-04-26T12:10:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204877+0000", 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9349999999999994e-06 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.204910+0000", 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2734999999999997e-05 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205030+0000", 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012008899999999999 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205205+0000", 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017510099999999999 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32503 5.2 5:4b5ff628:::benchmark_data_smithi045_43640_object32502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.205094+0000", 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0022962220000000001, 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027304500000000002, 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32503 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205094+0000", 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205094+0000", 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205093+0000", 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205155+0000", 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1958000000000005e-05 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205172+0000", 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6841999999999999e-05 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205181+0000", 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9129999999999992e-06 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206342+0000", 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00116059 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206467+0000", 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012563900000000001 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206578+0000", 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110707 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:32502 5.3 e22/17 5:c71d3e38:::benchmark_data_smithi045_43640_object32501:head v 22'2087, mlcod=22'2085)", 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.205382+0000", 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.002008616, 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025156940000000002, 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205382+0000", 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205382+0000", 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205381+0000", 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205445+0000", 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3427000000000001e-05 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205456+0000", 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1515000000000001e-05 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205463+0000", 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:10:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205500+0000", 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6910999999999999e-05 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205521+0000", 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207867+0000", 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00234592 2024-04-26T12:10:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207897+0000", 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0738999999999998e-05 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32505 5.2 5:446610a3:::benchmark_data_smithi045_43640_object32504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.205705+0000", 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0016856309999999999, 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022985369999999998, 2024-04-26T12:10:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32505 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205705+0000", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205705+0000", 2024-04-26T12:10:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.205704+0000", 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206222+0000", 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051798999999999997 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206318+0000", 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6545000000000005e-05 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206325+0000", 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2960000000000004e-06 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207300+0000", 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097550700000000002 2024-04-26T12:10:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207385+0000", 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4771000000000005e-05 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207511+0000", 2024-04-26T12:10:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012613300000000001 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32506 5.2 5.5183ec02 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.206332+0000", 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.001058525, 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001756643, 2024-04-26T12:10:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32506 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206332+0000", 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206332+0000", 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206331+0000", 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206358+0000", 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6437000000000001e-05 2024-04-26T12:10:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206365+0000", 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5560000000000002e-06 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.206371+0000", 2024-04-26T12:10:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0159999999999997e-06 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4719.0:32489 5.2 e22/17)", 2024-04-26T12:10:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.207035+0000", 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.000355674, 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001102811, 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207035+0000", 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207035+0000", 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207034+0000", 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207039+0000", 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8960000000000002e-06 2024-04-26T12:10:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207049+0000", 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0051000000000001e-05 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207057+0000", 2024-04-26T12:10:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7409999999999992e-06 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:32510 5.9 5:961d40a9:::benchmark_data_smithi045_43640_object32509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.207605+0000", 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4294967295.9997854, 2024-04-26T12:10:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058456999999999997, 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 32510 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207605+0000", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207605+0000", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207604+0000", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207711+0000", 2024-04-26T12:10:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107351 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207724+0000", 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2182e-05 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207732+0000", 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.038e-06 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207764+0000", 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2233000000000001e-05 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207864+0000", 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100122 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.207979+0000", 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114812 2024-04-26T12:10:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-26T12:10:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 12 2024-04-26T12:10:21.272 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:21.273 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:21.287 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:21.286+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:21.388 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:21.387+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:21.489 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:21.488+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-26T12:10:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-26T12:10:21.490 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:21.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:21.591 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:21.590+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:21.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 9 16 33721 33705 234.033 185.188 0.005358 0.00426895 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:162 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.307859213, 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013269345, 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 162 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373732+0000", 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373734+0000", 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2129999999999998e-06 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373737+0000", 2024-04-26T12:10:21.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373740+0000", 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6369999999999999e-06 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381599+0000", 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078590029999999998 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381657+0000", 2024-04-26T12:10:21.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7948000000000002e-05 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.381742+0000", 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5070999999999999e-05 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386318+0000", 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004576508 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386923+0000", 2024-04-26T12:10:21.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000604369 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386965+0000", 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1708000000000001e-05 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387001+0000", 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6709999999999999e-05 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:163 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.307848579999998, 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013403248, 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 163 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373743+0000", 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373742+0000", 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373745+0000", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373748+0000", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1640000000000001e-06 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373750+0000", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.463e-06 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382013+0000", 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082630099999999995 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382092+0000", 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8720999999999994e-05 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382214+0000", 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012222200000000001 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387012+0000", 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047978430000000004 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387055+0000", 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3129e-05 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387105+0000", 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9372000000000001e-05 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387146+0000", 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1205999999999998e-05 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:164 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.307832822000002, 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013509999999999999, 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 164 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373758+0000", 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373788+0000", 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0052999999999998e-05 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373796+0000", 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2290000000000003e-06 2024-04-26T12:10:21.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373800+0000", 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3189999999999999e-06 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382597+0000", 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087972889999999998 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382675+0000", 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8343999999999994e-05 2024-04-26T12:10:21.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.382796+0000", 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120531 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387186+0000", 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043906459999999998 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387194+0000", 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3069999999999997e-06 2024-04-26T12:10:21.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387233+0000", 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9804e-05 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387268+0000", 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4867999999999999e-05 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.701 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4164.0:165 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.307788271, 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013631885999999999, 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4164", 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/3236388737", 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 165 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373803+0000", 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373805+0000", 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1110000000000002e-06 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373810+0000", 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.373813+0000", 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4419999999999998e-06 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386360+0000", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012547106000000001 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386446+0000", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.386582+0000", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136236 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387277+0000", 2024-04-26T12:10:21.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694698 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387391+0000", 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113725 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387416+0000", 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5188999999999999e-05 2024-04-26T12:10:21.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:45.387435+0000", 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8717000000000001e-05 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:21.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312273658999999, 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012714021000000001, 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369317+0000", 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369322+0000", 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9699999999999998e-06 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369328+0000", 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8839999999999997e-06 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369334+0000", 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9150000000000001e-06 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376462+0000", 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071274550000000004 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376544+0000", 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1843999999999998e-05 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376714+0000", 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017050400000000001 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380051+0000", 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033371189999999999 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381943+0000", 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018913689999999999 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381989+0000", 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6717e-05 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382031+0000", 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2126999999999998e-05 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.712 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312251586000002, 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013541195000000001, 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369340+0000", 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369339+0000", 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369343+0000", 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369350+0000", 2024-04-26T12:10:21.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1570000000000003e-06 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369356+0000", 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7540000000000003e-06 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380245+0000", 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010889272 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380388+0000", 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014244799999999999 2024-04-26T12:10:21.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.380794+0000", 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000406272 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382778+0000", 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019838590000000001 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382829+0000", 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1394000000000003e-05 2024-04-26T12:10:21.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382860+0000", 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0555999999999997e-05 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382881+0000", 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.103e-05 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.717 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312230579999998, 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013570262, 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369361+0000", 2024-04-26T12:10:21.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369360+0000", 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369363+0000", 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.326e-06 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369371+0000", 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9359999999999999e-06 2024-04-26T12:10:21.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369376+0000", 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0170000000000004e-06 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381153+0000", 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011776371000000001 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381240+0000", 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7603999999999997e-05 2024-04-26T12:10:21.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.381360+0000", 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011987 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382818+0000", 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014577539999999999 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382888+0000", 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0110999999999993e-05 2024-04-26T12:10:21.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382912+0000", 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4270999999999999e-05 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382931+0000", 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8471e-05 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.722 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312209787999997, 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014056391999999999, 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:21.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369381+0000", 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369385+0000", 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7639999999999999e-06 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369391+0000", 2024-04-26T12:10:21.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0990000000000004e-06 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369396+0000", 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.31e-06 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382075+0000", 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012678952 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382146+0000", 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0817999999999999e-05 2024-04-26T12:10:21.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382232+0000", 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6238999999999999e-05 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383023+0000", 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00079041699999999996 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383384+0000", 2024-04-26T12:10:21.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036165299999999997 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383418+0000", 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4171000000000002e-05 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383438+0000", 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312174227, 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015550154, 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369417+0000", 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369416+0000", 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369429+0000", 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2826000000000001e-05 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369438+0000", 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8349999999999993e-06 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369445+0000", 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5869999999999998e-06 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382426+0000", 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012981670000000001 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382511+0000", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4915999999999998e-05 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382605+0000", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4176000000000001e-05 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.383461+0000", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085609599999999998 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384909+0000", 2024-04-26T12:10:21.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00144746 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384941+0000", 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2209999999999998e-05 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.384967+0000", 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.599e-05 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312084562999999, 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012938036999999999, 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369507+0000", 2024-04-26T12:10:21.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369506+0000", 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369517+0000", 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1212999999999999e-05 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369524+0000", 2024-04-26T12:10:21.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0960000000000003e-06 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369534+0000", 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8390000000000002e-06 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374150+0000", 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046155700000000003 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374820+0000", 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067048499999999996 2024-04-26T12:10:21.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.374962+0000", 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141936 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.378959+0000", 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039968160000000003 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382351+0000", 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003391813 2024-04-26T12:10:21.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382388+0000", 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7075e-05 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382445+0000", 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6560000000000001e-05 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.312038323000003, 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013278130000000001, 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369553+0000", 2024-04-26T12:10:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369552+0000", 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369556+0000", 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0559999999999998e-06 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369566+0000", 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0131e-05 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.369572+0000", 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1319999999999999e-06 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375385+0000", 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058125659999999999 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.375915+0000", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000529898 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.376132+0000", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000217247 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.379294+0000", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031621560000000002 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382748+0000", 2024-04-26T12:10:21.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034539699999999998 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382796+0000", 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7772999999999998e-05 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:09:49.382831+0000", 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4848999999999998e-05 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:8884 5.2 5:473218bb:::benchmark_data_smithi045_43640_object8883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:14.250229+0000", 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.4313620919999996, 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013457143, 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8884 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250229+0000", 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250229+0000", 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250228+0000", 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250282+0000", 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3291000000000002e-05 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250291+0000", 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6220000000000004e-06 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250297+0000", 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2380000000000002e-06 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250327+0000", 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9408999999999999e-05 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250411+0000", 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4473000000000003e-05 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.250493+0000", 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2094000000000004e-05 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251178+0000", 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068480500000000003 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.263600+0000", 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012422290000000001 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.263648+0000", 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7874000000000003e-05 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.263686+0000", 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7799000000000002e-05 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:8891 5.7 5:e9c6fa8a:::benchmark_data_smithi045_43640_object8890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.4304489680000003, 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013024897000000001, 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8891 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251142+0000", 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251334+0000", 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019247900000000001 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251341+0000", 2024-04-26T12:10:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.396e-06 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251349+0000", 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.909e-06 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251378+0000", 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.866e-05 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251496+0000", 2024-04-26T12:10:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118078 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251638+0000", 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014185900000000001 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.252909+0000", 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012713329999999999 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264117+0000", 2024-04-26T12:10:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011208174 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264146+0000", 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8140000000000002e-05 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264167+0000", 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1497000000000001e-05 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:8896 5.1 5:8ae0dfb6:::benchmark_data_smithi045_43640_object8895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.4302338299999997, 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012812172, 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 8896 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251357+0000", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251475+0000", 2024-04-26T12:10:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011808500000000001 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251484+0000", 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251487+0000", 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7280000000000001e-06 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251518+0000", 2024-04-26T12:10:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0651000000000002e-05 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251607+0000", 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9195000000000002e-05 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.251691+0000", 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4048000000000006e-05 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.252577+0000", 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088533800000000005 2024-04-26T12:10:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264110+0000", 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011533692 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264145+0000", 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4898999999999999e-05 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:14.264169+0000", 2024-04-26T12:10:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:18437 5.2 5:43b095c9:::benchmark_data_smithi045_43640_object18436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9203657390000002, 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013489296, 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 18437 2024-04-26T12:10:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761225+0000", 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761332+0000", 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010694199999999999 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761340+0000", 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0010000000000001e-06 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761345+0000", 2024-04-26T12:10:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761383+0000", 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8077999999999997e-05 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761505+0000", 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121848 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761637+0000", 2024-04-26T12:10:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131536 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.764883+0000", 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003246292 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774623+0000", 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097397160000000007 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774681+0000", 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8740999999999999e-05 2024-04-26T12:10:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774715+0000", 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3297999999999999e-05 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:18441 5.7 5:e6d96e0a:::benchmark_data_smithi045_43640_object18440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.920084846, 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013210398, 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 18441 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761506+0000", 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761543+0000", 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7670999999999999e-05 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761551+0000", 2024-04-26T12:10:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5129999999999999e-06 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761558+0000", 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.34e-06 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761730+0000", 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017144999999999999 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761801+0000", 2024-04-26T12:10:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1165000000000001e-05 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.761878+0000", 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6716000000000002e-05 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.765725+0000", 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003847301 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774625+0000", 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089006410000000008 2024-04-26T12:10:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774678+0000", 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2859999999999999e-05 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:16.774717+0000", 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8362000000000003e-05 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33016 5.f 5:fe35aebe:::benchmark_data_smithi045_43640_object33015:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.373266+0000", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.30832559100000001, 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013201789, 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33016 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.373266+0000", 2024-04-26T12:10:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.373266+0000", 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.373265+0000", 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.373291+0000", 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6421999999999999e-05 2024-04-26T12:10:21.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.373304+0000", 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2533e-05 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.373311+0000", 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3610000000000003e-06 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.375320+0000", 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002009421 2024-04-26T12:10:21.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.375483+0000", 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016226899999999999 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.375639+0000", 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015626600000000001 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.378364+0000", 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002725239 2024-04-26T12:10:21.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.386402+0000", 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080373159999999992 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.386430+0000", 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8824999999999999e-05 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.386467+0000", 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:10:21.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33388 5.1 5:80b6dc68:::benchmark_data_smithi045_43640_object33387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.492528+0000", 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.189062749, 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012698568, 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33388 2024-04-26T12:10:21.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492528+0000", 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492528+0000", 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492528+0000", 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492562+0000", 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4369999999999998e-05 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492569+0000", 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4269999999999996e-06 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492573+0000", 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8530000000000002e-06 2024-04-26T12:10:21.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.495857+0000", 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003283963 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.496016+0000", 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015941800000000001 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.496199+0000", 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018313100000000001 2024-04-26T12:10:21.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.501771+0000", 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055714290000000001 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.505166+0000", 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033956030000000001 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.505195+0000", 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8917000000000001e-05 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.505227+0000", 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1847999999999997e-05 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33390 5.1 5:88c667be:::benchmark_data_smithi045_43640_object33389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.492660+0000", 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.18893099399999999, 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013166224000000001, 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33390 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492660+0000", 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492660+0000", 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492660+0000", 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492751+0000", 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1059999999999999e-05 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492757+0000", 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2519999999999996e-06 2024-04-26T12:10:21.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.492763+0000", 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5199999999999997e-06 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.497388+0000", 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004625232 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.497487+0000", 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9057999999999999e-05 2024-04-26T12:10:21.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.497607+0000", 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119851 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.501774+0000", 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041669130000000004 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.505753+0000", 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039789329999999996 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.505793+0000", 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0562000000000002e-05 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.505826+0000", 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3243e-05 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33759 5.1 5:84a1f1a6:::benchmark_data_smithi045_43640_object33758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:21.785 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.065141747999999999, 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016968066, 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33759 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616495+0000", 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5689999999999998e-05 2024-04-26T12:10:21.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616500+0000", 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6540000000000004e-06 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616504+0000", 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622769+0000", 2024-04-26T12:10:21.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062649180000000004 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622858+0000", 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9061000000000007e-05 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622968+0000", 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109968 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.626085+0000", 2024-04-26T12:10:21.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031169380000000001 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633354+0000", 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007269195 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633393+0000", 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-05 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633417+0000", 2024-04-26T12:10:21.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4714000000000001e-05 2024-04-26T12:10:21.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:21.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:21.791 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:21.792 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:21.791+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:21.793 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:21.893 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:21.892+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:10:21.932 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:10:21.932 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:21.932 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:10:21.932 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:10:21.932 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:10:21.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34815 5.8 5:1c1343c1:::benchmark_data_smithi045_43640_object34814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.971184+0000", 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0041498589999999997, 2024-04-26T12:10:21.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041711730000000002, 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34815 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971184+0000", 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:21.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971184+0000", 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971182+0000", 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999981 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971240+0000", 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7760000000000003e-05 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971249+0000", 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1849999999999993e-06 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971255+0000", 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6330000000000001e-06 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971304+0000", 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9468000000000001e-05 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971406+0000", 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010186 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.971502+0000", 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6310000000000005e-05 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975005+0000", 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035028210000000001 2024-04-26T12:10:21.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975323+0000", 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000318136 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34820 5.8 5:14ac2789:::benchmark_data_smithi045_43640_object34819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.973545+0000", 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001788418, 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001870806, 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:21.985 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34820 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973545+0000", 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:21.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973545+0000", 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973544+0000", 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973611+0000", 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.669e-05 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:21.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973623+0000", 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1758e-05 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973631+0000", 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3100000000000001e-06 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973692+0000", 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0829999999999999e-05 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973821+0000", 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012863600000000001 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.973946+0000", 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012584099999999999 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:34820 5.8 e23/17)", 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.975397+0000", 2024-04-26T12:10:21.989 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9999361, 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2820999999999999e-05, 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975397+0000", 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975397+0000", 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975397+0000", 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975400+0000", 2024-04-26T12:10:21.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.18e-06 2024-04-26T12:10:21.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:21.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975409+0000", 2024-04-26T12:10:21.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3909999999999998e-06 2024-04-26T12:10:21.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975414+0000", 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5010000000000004e-06 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975470+0000", 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5556000000000001e-05 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975478+0000", 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3180000000000007e-06 2024-04-26T12:10:21.995 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34826 5.8 5.4b751138 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.975436+0000", 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998975, 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2171999999999998e-05, 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:21.996 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34826 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975436+0000", 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975436+0000", 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:21.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975435+0000", 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975493+0000", 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7794000000000003e-05 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975501+0000", 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0390000000000005e-06 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975506+0000", 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1869999999999996e-06 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34827 5.e 5.a73953de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.975515+0000", 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998183, 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3823999999999998e-05, 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:21.999 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34827 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975515+0000", 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975515+0000", 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975515+0000", 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975548+0000", 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3614e-05 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975554+0000", 2024-04-26T12:10:22.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.975557+0000", 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.641e-06 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 5 2024-04-26T12:10:22.002 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:22.003 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:22.003+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:22.004 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:22.105 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:22.104+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:22.130 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:10:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:22.200 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:22.200 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:22.200 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:22.200 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:22.200 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:22.206 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:22.205+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:22.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:22.306 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:22.305+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:22.395 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:22.395 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.026158525, 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013096059, 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:22.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366763+0000", 2024-04-26T12:10:22.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4530000000000001e-06 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366772+0000", 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.251e-06 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366783+0000", 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0886999999999999e-05 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370530+0000", 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037465969999999999 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370615+0000", 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5364999999999993e-05 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370790+0000", 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017513300000000001 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373719+0000", 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002928614 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379758+0000", 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060387740000000002 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379803+0000", 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5123999999999997e-05 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379854+0000", 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1637e-05 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:22.404 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.025575627000002, 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012775111, 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367341+0000", 2024-04-26T12:10:22.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367340+0000", 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367348+0000", 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.311e-06 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367368+0000", 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0517999999999999e-05 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.367378+0000", 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8770000000000005e-06 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371711+0000", 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00433287 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371850+0000", 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013893099999999999 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.371990+0000", 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000140288 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373945+0000", 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019548970000000001 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380017+0000", 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060725060000000001 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380069+0000", 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1909000000000001e-05 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.380116+0000", 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6941999999999999e-05 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.024418425, 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012850874999999999, 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.410 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368498+0000", 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368504+0000", 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368514+0000", 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0190000000000001e-05 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368523+0000", 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9509999999999995e-06 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.372499+0000", 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039758789999999999 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373036+0000", 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00053641300000000002 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373189+0000", 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000153029 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.374345+0000", 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001156453 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381242+0000", 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068968930000000003 2024-04-26T12:10:22.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381300+0000", 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8038000000000002e-05 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381349+0000", 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9258000000000002e-05 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.415 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.024330652000003, 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012764034, 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368586+0000", 2024-04-26T12:10:22.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368585+0000", 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368591+0000", 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368597+0000", 2024-04-26T12:10:22.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7460000000000003e-06 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.368602+0000", 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0799999999999996e-06 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373059+0000", 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044562059999999999 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373178+0000", 2024-04-26T12:10:22.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011930900000000001 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373318+0000", 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014009499999999999 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.374382+0000", 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001064382 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381272+0000", 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0068900719999999997 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381312+0000", 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9266e-05 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.381350+0000", 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8510000000000002e-05 2024-04-26T12:10:22.421 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8885 5.0 5:05f43a42:::benchmark_data_smithi045_43640_object8884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.1425122709999993, 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013442571, 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.422 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8885 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250404+0000", 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250440+0000", 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6013000000000002e-05 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250450+0000", 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9969999999999993e-06 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250456+0000", 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9009999999999999e-06 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250484+0000", 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8342000000000001e-05 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250567+0000", 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2417999999999996e-05 2024-04-26T12:10:22.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250649+0000", 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2315e-05 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251244+0000", 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00059499200000000003 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263693+0000", 2024-04-26T12:10:22.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012449276 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263774+0000", 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0716000000000004e-05 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263847+0000", 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3318999999999994e-05 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8887 5.4 5:2f729b2c:::benchmark_data_smithi045_43640_object8886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.1420055169999994, 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013197943, 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8887 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.428 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250910+0000", 2024-04-26T12:10:22.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251023+0000", 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112483 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251033+0000", 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0395e-05 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251041+0000", 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4150000000000002e-06 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251082+0000", 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0892000000000001e-05 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251182+0000", 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100005 2024-04-26T12:10:22.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251313+0000", 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013093999999999999 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252305+0000", 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00099206800000000003 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264059+0000", 2024-04-26T12:10:22.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011754114 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264088+0000", 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9246000000000001e-05 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264109+0000", 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1291e-05 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.433 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8892 5.8 5:1ec4722e:::benchmark_data_smithi045_43640_object8891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251257+0000", 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.1416598570000005, 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012979917000000001, 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8892 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251257+0000", 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251257+0000", 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251256+0000", 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251392+0000", 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013522100000000001 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251398+0000", 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.959e-06 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251401+0000", 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7120000000000002e-06 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251429+0000", 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7492e-05 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251528+0000", 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9394000000000004e-05 2024-04-26T12:10:22.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251657+0000", 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012882900000000001 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252671+0000", 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010136590000000001 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264178+0000", 2024-04-26T12:10:22.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011507631000000001 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264207+0000", 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8381000000000002e-05 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264237+0000", 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0303000000000001e-05 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8894 5.b 5:d28e84bb:::benchmark_data_smithi045_43640_object8893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.1415100529999993, 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013316091, 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8894 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251406+0000", 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251547+0000", 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141116 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251556+0000", 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3089999999999996e-06 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251563+0000", 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5399999999999998e-06 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251601+0000", 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7861999999999998e-05 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251717+0000", 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000115507 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251848+0000", 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131252 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253099+0000", 2024-04-26T12:10:22.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001251252 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264673+0000", 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011573603 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264703+0000", 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0605999999999998e-05 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264723+0000", 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9544000000000001e-05 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8895 5.8 5:1a1d64bc:::benchmark_data_smithi045_43640_object8894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.1413437739999992, 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012735948, 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.446 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8895 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251573+0000", 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251635+0000", 2024-04-26T12:10:22.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2781999999999996e-05 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251643+0000", 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5669999999999997e-06 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251650+0000", 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252079+0000", 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00042977500000000002 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252216+0000", 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013720200000000001 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252318+0000", 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000101742 2024-04-26T12:10:22.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252997+0000", 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00067903799999999997 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264258+0000", 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011260859999999999 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264281+0000", 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.266e-05 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264309+0000", 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8262000000000001e-05 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18435 5.b 5:d1429ed2:::benchmark_data_smithi045_43640_object18434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:22.452 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.6317738720000001, 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013538150000000001, 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18435 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:22.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761142+0000", 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761199+0000", 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6650999999999997e-05 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761206+0000", 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.391e-06 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761211+0000", 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8380000000000001e-06 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761236+0000", 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4709999999999999e-05 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761314+0000", 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8343000000000005e-05 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761398+0000", 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3653999999999996e-05 2024-04-26T12:10:22.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762811+0000", 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014135840000000001 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774484+0000", 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011672561 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774626+0000", 2024-04-26T12:10:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014174500000000001 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774681+0000", 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5495000000000003e-05 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18436 5.8 5:171915a6:::benchmark_data_smithi045_43640_object18435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.6317000940000002, 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013344784, 2024-04-26T12:10:22.458 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18436 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761216+0000", 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761311+0000", 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4912000000000002e-05 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761317+0000", 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5500000000000002e-06 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761321+0000", 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6559999999999998e-06 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761355+0000", 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4289999999999999e-05 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761462+0000", 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106743 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761550+0000", 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8185999999999999e-05 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762740+0000", 2024-04-26T12:10:22.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011899250000000001 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774429+0000", 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011689643 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774508+0000", 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8405999999999994e-05 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774562+0000", 2024-04-26T12:10:22.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3811999999999999e-05 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18443 5.e 5:7a1f377a:::benchmark_data_smithi045_43640_object18442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.6312459300000004, 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013395112000000001, 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18443 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761670+0000", 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761698+0000", 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7858e-05 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761716+0000", 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:22.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761722+0000", 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0140000000000004e-06 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761764+0000", 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2364999999999998e-05 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761883+0000", 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119024 2024-04-26T12:10:22.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762031+0000", 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014787000000000001 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763327+0000", 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012958309999999999 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775010+0000", 2024-04-26T12:10:22.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011683037 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775034+0000", 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4496999999999999e-05 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775066+0000", 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1890999999999997e-05 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18445 5.4 5:2b1a26ab:::benchmark_data_smithi045_43640_object18444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.6300633979999999, 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014248856000000001, 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18445 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762903+0000", 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0436999999999998e-05 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762912+0000", 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5790000000000004e-06 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762919+0000", 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:22.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762960+0000", 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1046e-05 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763044+0000", 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3788999999999993e-05 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763132+0000", 2024-04-26T12:10:22.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8162000000000001e-05 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763995+0000", 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00086267500000000003 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777026+0000", 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013031093000000001 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777068+0000", 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1953000000000003e-05 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777102+0000", 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4746000000000002e-05 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:21456 5.d 5:bd08ac67:::benchmark_data_smithi045_43640_object21455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.475 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.616220+0000", 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.77669693, 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012852683, 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 21456 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616220+0000", 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616220+0000", 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616219+0000", 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616356+0000", 2024-04-26T12:10:22.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013698399999999999 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616364+0000", 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1269999999999997e-06 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.616370+0000", 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1999999999999999e-06 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.617112+0000", 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00074222899999999996 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.617230+0000", 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011794999999999999 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.617366+0000", 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013623199999999999 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.618781+0000", 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014152170000000001 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.628984+0000", 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010203017999999999 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.629034+0000", 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.629073+0000", 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8702999999999999e-05 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22165 5.0 5:052deb84:::benchmark_data_smithi045_43640_object22164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5413745619999997, 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013303288999999999, 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22165 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851674+0000", 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000132664 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851683+0000", 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2930000000000001e-06 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851690+0000", 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3699999999999997e-06 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852246+0000", 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00055546700000000003 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852392+0000", 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014629700000000001 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852555+0000", 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016261699999999999 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854109+0000", 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001554656 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864757+0000", 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010647439999999999 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864802+0000", 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5751999999999998e-05 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864846+0000", 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3238999999999997e-05 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.486 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22167 5.8 5:13422a89:::benchmark_data_smithi045_43640_object22166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5412208500000002, 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01318099, 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22167 2024-04-26T12:10:22.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851695+0000", 2024-04-26T12:10:22.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851813+0000", 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117843 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851821+0000", 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.661e-06 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851827+0000", 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1789999999999996e-06 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852237+0000", 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00041010299999999999 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852404+0000", 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000167195 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852582+0000", 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017714099999999999 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854116+0000", 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001534856 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864794+0000", 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010677246 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864841+0000", 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7003999999999999e-05 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864877+0000", 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6338999999999999e-05 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22171 5.e 5:7b7def9e:::benchmark_data_smithi045_43640_object22170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.854032+0000", 2024-04-26T12:10:22.492 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5388851289999996, 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012594522, 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22171 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854032+0000", 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854032+0000", 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854031+0000", 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854135+0000", 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104557 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854147+0000", 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1985e-05 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854156+0000", 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1710000000000002e-06 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854195+0000", 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9150000000000003e-05 2024-04-26T12:10:22.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854299+0000", 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103992 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854383+0000", 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3968999999999995e-05 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.855475+0000", 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010926849999999999 2024-04-26T12:10:22.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.866519+0000", 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011043499 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.866575+0000", 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.866626+0000", 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1190999999999998e-05 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34842 5.b 5:d6f421a9:::benchmark_data_smithi045_43640_object34841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.411855692, 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014832164, 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.498 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34842 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:22.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981194+0000", 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013305899999999999 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981201+0000", 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4440000000000002e-06 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981207+0000", 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1689999999999997e-06 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982376+0000", 2024-04-26T12:10:22.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001168531 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982492+0000", 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116359 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982618+0000", 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000125387 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.984635+0000", 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020174680000000001 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995828+0000", 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011192366 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995871+0000", 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3260000000000003e-05 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995893+0000", 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2554000000000001e-05 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34848 5.4 5:2a4916b0:::benchmark_data_smithi045_43640_object34847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.41157983399999998, 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014588217000000001, 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.504 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34848 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981465+0000", 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012813200000000001 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981473+0000", 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6470000000000004e-06 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981480+0000", 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5200000000000003e-06 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982512+0000", 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010321250000000001 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982619+0000", 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107509 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982736+0000", 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116821 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.985587+0000", 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002851124 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995838+0000", 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010250987 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995889+0000", 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0865999999999997e-05 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995925+0000", 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5991999999999997e-05 2024-04-26T12:10:22.509 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34849 5.8 5:19ff06c8:::benchmark_data_smithi045_43640_object34848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.982109+0000", 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.41080787600000002, 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013794107999999999, 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:22.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34849 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982109+0000", 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982109+0000", 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:22.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982108+0000", 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982137+0000", 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8994000000000001e-05 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982147+0000", 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6569999999999992e-06 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982154+0000", 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9480000000000002e-06 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982194+0000", 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9852999999999999e-05 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982307+0000", 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112946 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982445+0000", 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013894800000000001 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.985056+0000", 2024-04-26T12:10:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026107000000000001 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995808+0000", 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010751449 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995863+0000", 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5837000000000001e-05 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995903+0000", 2024-04-26T12:10:22.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9620999999999999e-05 2024-04-26T12:10:22.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.516 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:22.516 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:22.516 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:22.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:22.518 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:22.516+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:22.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 10 15 36613 36598 228.71 180.812 0.00717904 0.00436767 2024-04-26T12:10:22.617 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:22.617+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:22.705 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:22.705 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:22.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.705 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:36900 5.b e23/17 5:d7c7bc84:::benchmark_data_smithi045_43640_object36899:head v 23'2297, mlcod=23'2295)", 2024-04-26T12:10:22.705 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.699378+0000", 2024-04-26T12:10:22.705 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029497030000000001, 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029730339999999998, 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699378+0000", 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699378+0000", 2024-04-26T12:10:22.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699378+0000", 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699406+0000", 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8311999999999999e-05 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699410+0000", 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1529999999999999e-06 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699413+0000", 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699449+0000", 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5865000000000003e-05 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699470+0000", 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1124999999999998e-05 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:36903 5.a 5:5fc416f7:::benchmark_data_smithi045_43640_object36902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.700849+0000", 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001478968, 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0015782350000000001, 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:22.709 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 36903 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700849+0000", 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700849+0000", 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700848+0000", 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700946+0000", 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8053000000000005e-05 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700957+0000", 2024-04-26T12:10:22.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1029000000000001e-05 2024-04-26T12:10:22.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700964+0000", 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.537e-06 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701008+0000", 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3402000000000002e-05 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701096+0000", 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7755000000000003e-05 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701175+0000", 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9919000000000005e-05 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.714 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:36901 5.2 e23/17 5:4131dbc6:::benchmark_data_smithi045_43640_object36900:head v 23'2301, mlcod=23'2298)", 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.701189+0000", 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0011386840000000001, 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001317866, 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701189+0000", 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701189+0000", 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701189+0000", 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701252+0000", 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2995000000000002e-05 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701260+0000", 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2449999999999998e-06 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701266+0000", 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.127e-06 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701310+0000", 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3893000000000001e-05 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701334+0000", 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3790000000000001e-05 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:36906 5.6 5:6f94503c:::benchmark_data_smithi045_43640_object36905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.718 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.701290+0000", 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001038034, 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00129149, 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 36906 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701290+0000", 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701290+0000", 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701289+0000", 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701343+0000", 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3977000000000002e-05 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701356+0000", 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3241000000000001e-05 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701363+0000", 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.674e-06 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701410+0000", 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7277000000000002e-05 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701521+0000", 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011056999999999999 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701671+0000", 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014993499999999999 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.722 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:36907 5.5 5:a0a5ec5a:::benchmark_data_smithi045_43640_object36906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.701376+0000", 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00095229099999999997, 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001291873, 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 36907 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.723 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701376+0000", 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701376+0000", 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701375+0000", 2024-04-26T12:10:22.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701405+0000", 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9433000000000001e-05 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701410+0000", 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701415+0000", 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7010000000000004e-06 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701446+0000", 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1016999999999998e-05 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701557+0000", 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011111399999999999 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701691+0000", 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013416400000000001 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:36905 5.7 e23/17 5:e2c51a38:::benchmark_data_smithi045_43640_object36904:head v 23'2335, mlcod=23'2333)", 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.701551+0000", 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00077663700000000005, 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012215030000000001, 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:22.727 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701551+0000", 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701551+0000", 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701551+0000", 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701624+0000", 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3374999999999995e-05 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701632+0000", 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5780000000000001e-06 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701637+0000", 2024-04-26T12:10:22.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6409999999999999e-06 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701670+0000", 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2892000000000003e-05 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701689+0000", 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.889e-05 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:36898 5.5 e23/17 ondisk, result = 0)", 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.701757+0000", 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00057053300000000002, 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001084972, 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701757+0000", 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701757+0000", 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701757+0000", 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701761+0000", 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9960000000000004e-06 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701769+0000", 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7989999999999994e-06 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.701775+0000", 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0229999999999998e-06 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702814+0000", 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001039321 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702821+0000", 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8360000000000003e-06 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:36908 5.0 e23/17 5:0dd7d24e:::benchmark_data_smithi045_43640_object36907:head v 23'2332, mlcod=23'2330)", 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.702559+0000", 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9997687, 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00035104800000000002, 2024-04-26T12:10:22.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702559+0000", 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702559+0000", 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702558+0000", 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702589+0000", 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0372e-05 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702601+0000", 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2104e-05 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702607+0000", 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4579999999999998e-06 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702639+0000", 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1860000000000003e-05 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702658+0000", 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.878e-05 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.737 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:36895 5.c 5:3315ba59:::benchmark_data_smithi045_43640_object36894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.697512+0000", 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0048161419999999998, 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00543992, 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 36895 2024-04-26T12:10:22.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.697512+0000", 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.697512+0000", 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:22.739 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.697511+0000", 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.697544+0000", 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2956000000000001e-05 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.697551+0000", 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5989999999999998e-06 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:22.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.697556+0000", 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1390000000000003e-06 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.699925+0000", 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023692850000000001 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700060+0000", 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013469600000000001 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:22.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.700196+0000", 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000136243 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.702437+0000", 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022407640000000001 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 9 2024-04-26T12:10:22.742 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:22.744 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:22.744 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:22.743+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:22.845 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:22.844+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:22.930 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:22.930 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:22.930 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:22.930 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:22.930 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:22.946 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:22.945+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:22.946 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:23.047 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:23.046+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:23.147 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:23.146+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:23.176 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.806770640000003, 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016256112, 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365793+0000", 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999952 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365806+0000", 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3039e-05 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365819+0000", 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3132000000000001e-05 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365834+0000", 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365953+0000", 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011895700000000001 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375316+0000", 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093566369999999992 2024-04-26T12:10:23.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375394+0000", 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7732999999999996e-05 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375472+0000", 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8182999999999993e-05 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381062+0000", 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055902030000000002 2024-04-26T12:10:23.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381964+0000", 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090143000000000005 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382012+0000", 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8192999999999998e-05 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382054+0000", 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1936e-05 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.183 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.806709054000002, 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016298395, 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:23.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365858+0000", 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365864+0000", 2024-04-26T12:10:23.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365873+0000", 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365882+0000", 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4989999999999994e-06 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366075+0000", 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019275499999999999 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366080+0000", 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375717+0000", 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096367499999999995 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375784+0000", 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6649000000000005e-05 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375898+0000", 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011433 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381103+0000", 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052053610000000004 2024-04-26T12:10:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382076+0000", 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097246799999999999 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382121+0000", 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5714999999999999e-05 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382158+0000", 2024-04-26T12:10:23.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6174999999999998e-05 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.806680884999999, 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:23.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.196 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.806608547000003, 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:23.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:23.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:23.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.806578012000003, 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016265910000000001, 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365994+0000", 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366006+0000", 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1816e-05 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366011+0000", 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368181+0000", 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021698279999999999 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368185+0000", 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4900000000000002e-06 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376058+0000", 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078721069999999997 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376139+0000", 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0958000000000007e-05 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376224+0000", 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5680000000000006e-05 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381953+0000", 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057284379999999998 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382171+0000", 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021846100000000001 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382221+0000", 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9869e-05 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382256+0000", 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5182999999999998e-05 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.209 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.806341844999999, 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01469869, 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:23.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366232+0000", 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1530000000000002e-06 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366243+0000", 2024-04-26T12:10:23.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1103e-05 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366260+0000", 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022716699999999999 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368538+0000", 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9270000000000002e-06 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373128+0000", 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045899799999999996 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373834+0000", 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00070583699999999996 2024-04-26T12:10:23.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374269+0000", 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00043562499999999998 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380083+0000", 2024-04-26T12:10:23.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0058130949999999999 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380821+0000", 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00073799399999999995 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380880+0000", 2024-04-26T12:10:23.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9001e-05 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380925+0000", 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5617e-05 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.804960033, 2024-04-26T12:10:23.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01400622, 2024-04-26T12:10:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367608+0000", 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367605+0000", 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999967 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367613+0000", 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5059999999999995e-06 2024-04-26T12:10:23.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367625+0000", 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2114e-05 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367637+0000", 2024-04-26T12:10:23.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1739999999999999e-05 2024-04-26T12:10:23.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369337+0000", 2024-04-26T12:10:23.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001699519 2024-04-26T12:10:23.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:23.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.369342+0000", 2024-04-26T12:10:23.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:10:23.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374717+0000", 2024-04-26T12:10:23.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053750869999999997 2024-04-26T12:10:23.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375164+0000", 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00044635699999999998 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381614+0000", 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0064507310000000003 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:23.229 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 33.804922904000001, 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015300935, 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:23.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367648+0000", 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.659e-06 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367657+0000", 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367667+0000", 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368391+0000", 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072424000000000002 2024-04-26T12:10:23.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:23.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368397+0000", 2024-04-26T12:10:23.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6389999999999997e-06 2024-04-26T12:10:23.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377728+0000", 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093318099999999994 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377867+0000", 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013898 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382946+0000", 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050788350000000003 2024-04-26T12:10:23.236 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18434 5.c 5:3c132dfb:::benchmark_data_smithi045_43640_object18433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:23.237 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.411535829, 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014988885, 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18434 2024-04-26T12:10:23.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:23.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761099+0000", 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7621999999999997e-05 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761107+0000", 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.306e-06 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761113+0000", 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8499999999999999e-06 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761148+0000", 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5754999999999999e-05 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761273+0000", 2024-04-26T12:10:23.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000124139 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761402+0000", 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012899799999999999 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.774898+0000", 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013496144 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.775945+0000", 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010469100000000001 2024-04-26T12:10:23.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.775986+0000", 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1459999999999999e-05 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776021+0000", 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5305999999999997e-05 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.245 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18438 5.c 5:300cc216:::benchmark_data_smithi045_43640_object18437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.411315782, 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014878529999999999, 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18438 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761319+0000", 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7223000000000003e-05 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761325+0000", 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7150000000000003e-06 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761329+0000", 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9430000000000002e-06 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.762964+0000", 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016356090000000001 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.763091+0000", 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000126494 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.763236+0000", 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014511999999999999 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.774944+0000", 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011708260999999999 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776031+0000", 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001086762 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776076+0000", 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4594e-05 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776131+0000", 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5373e-05 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18440 5.c 5:367b11b7:::benchmark_data_smithi045_43640_object18439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.4112329929999996, 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015638973, 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.251 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18440 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:23.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761462+0000", 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012686699999999999 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761469+0000", 2024-04-26T12:10:23.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1770000000000001e-06 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761475+0000", 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7479999999999999e-06 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773562+0000", 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012087044999999999 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773709+0000", 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014781500000000001 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773863+0000", 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015342099999999999 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776173+0000", 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023097959999999998 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776895+0000", 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072276100000000004 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776938+0000", 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2503999999999998e-05 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776974+0000", 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6337999999999997e-05 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:22158 5.6 5:68f447fa:::benchmark_data_smithi045_43640_object22157:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:17.851003+0000", 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.3215656879999997, 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014526532, 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 22158 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851003+0000", 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851003+0000", 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851002+0000", 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851062+0000", 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0435e-05 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851071+0000", 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5390000000000007e-06 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851077+0000", 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2099999999999998e-06 2024-04-26T12:10:23.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851117+0000", 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9524000000000003e-05 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851243+0000", 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012636099999999999 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851330+0000", 2024-04-26T12:10:23.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7328000000000001e-05 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.853713+0000", 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023822230000000002 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865445+0000", 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011731996 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865492+0000", 2024-04-26T12:10:23.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7565999999999998e-05 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865529+0000", 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6937999999999998e-05 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:22166 5.5 5:af42f330:::benchmark_data_smithi045_43640_object22165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:17.851331+0000", 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.3212373749999999, 2024-04-26T12:10:23.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014214922, 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 22166 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851331+0000", 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851331+0000", 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851330+0000", 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851471+0000", 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014117099999999999 2024-04-26T12:10:23.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851479+0000", 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8630000000000008e-06 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851483+0000", 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2250000000000002e-06 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.852013+0000", 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00052945599999999998 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.852976+0000", 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00096346699999999997 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.853121+0000", 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014475800000000001 2024-04-26T12:10:23.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.859089+0000", 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059678630000000003 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865459+0000", 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063695729999999999 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865504+0000", 2024-04-26T12:10:23.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5404000000000001e-05 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865546+0000", 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1851000000000003e-05 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:22169 5.6 5:67e36a3b:::benchmark_data_smithi045_43640_object22168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:17.851627+0000", 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.3209410180000001, 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013984992999999999, 2024-04-26T12:10:23.268 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 22169 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851627+0000", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851627+0000", 2024-04-26T12:10:23.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851627+0000", 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851720+0000", 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3047999999999994e-05 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851730+0000", 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0239e-05 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.851736+0000", 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.852236+0000", 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00050023600000000004 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.852357+0000", 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012057600000000001 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.852459+0000", 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000102706 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.854037+0000", 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0015772130000000001 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865539+0000", 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011502442 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865579+0000", 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0339999999999997e-05 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:17.865612+0000", 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2826e-05 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:23574 5.6 5:683cd0a4:::benchmark_data_smithi045_43640_object23573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:18.309656+0000", 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8629125860000002, 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014363592, 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 23574 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.274 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.309656+0000", 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.309656+0000", 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.309655+0000", 2024-04-26T12:10:23.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.309781+0000", 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000126024 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.309790+0000", 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5030000000000003e-06 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.309797+0000", 2024-04-26T12:10:23.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4099999999999996e-06 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.315159+0000", 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053622490000000004 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.315238+0000", 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8504000000000006e-05 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.315334+0000", 2024-04-26T12:10:23.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6556000000000002e-05 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.318886+0000", 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00355229 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.323931+0000", 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050441510000000002 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.323982+0000", 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1050000000000001e-05 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:18.324019+0000", 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7611000000000003e-05 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:33882 5.c 5:3f2da037:::benchmark_data_smithi045_43640_object33881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:21.660574+0000", 2024-04-26T12:10:23.279 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.5119944190000001, 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014279668000000001, 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 33882 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.280 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660574+0000", 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660574+0000", 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660573+0000", 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660661+0000", 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8313999999999995e-05 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660673+0000", 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1528e-05 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660681+0000", 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9999999999999996e-06 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660720+0000", 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9625000000000001e-05 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660861+0000", 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000140672 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.660997+0000", 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135752 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.664080+0000", 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030830160000000001 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.674799+0000", 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010719088 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.674832+0000", 2024-04-26T12:10:23.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3056999999999999e-05 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:21.674854+0000", 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1491000000000001e-05 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:37426 5.c 5:32884984:::benchmark_data_smithi045_43640_object37425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:22.873992+0000", 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.298576748, 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014032513, 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 37426 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.873992+0000", 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.873992+0000", 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.873991+0000", 2024-04-26T12:10:23.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.874116+0000", 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012461199999999999 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.874125+0000", 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6520000000000001e-06 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.874131+0000", 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8139999999999997e-06 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.874169+0000", 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8442999999999998e-05 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.874301+0000", 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000131805 2024-04-26T12:10:23.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.874440+0000", 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138963 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.876355+0000", 2024-04-26T12:10:23.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001915171 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.887939+0000", 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011583323 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.887987+0000", 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7973000000000003e-05 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:22.888024+0000", 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.731e-05 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:37888 5.a 5:5aaef1a2:::benchmark_data_smithi045_43640_object37887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:23.042026+0000", 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.13054226399999999, 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014064152, 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 37888 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042026+0000", 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042026+0000", 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042025+0000", 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042087+0000", 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1987000000000001e-05 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042095+0000", 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3610000000000003e-06 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042099+0000", 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:10:23.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.043048+0000", 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00094840799999999998 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.043129+0000", 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0885999999999998e-05 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.043205+0000", 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6188999999999998e-05 2024-04-26T12:10:23.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.047265+0000", 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040598769999999999 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.056013+0000", 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0087482619999999997 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.056059+0000", 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5989999999999998e-05 2024-04-26T12:10:23.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.056090+0000", 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1189000000000002e-05 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:37890 5.a 5:586d3755:::benchmark_data_smithi045_43640_object37889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.13033502, 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015306492999999999, 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.302 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 37890 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:23.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042281+0000", 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8075000000000003e-05 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042288+0000", 2024-04-26T12:10:23.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2289999999999997e-06 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042294+0000", 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0929999999999999e-06 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044619+0000", 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023244060000000002 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044746+0000", 2024-04-26T12:10:23.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012727499999999999 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044888+0000", 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014250800000000001 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.047298+0000", 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002409797 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057491+0000", 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010193160999999999 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057519+0000", 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.758e-05 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057540+0000", 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0908999999999999e-05 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:38079 5.c 5:36200901:::benchmark_data_smithi045_43640_object38078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:23.118624+0000", 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.053944732000000002, 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014455152000000001, 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 38079 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:23.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.118624+0000", 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.118624+0000", 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.118623+0000", 2024-04-26T12:10:23.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.118657+0000", 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4239000000000002e-05 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.118669+0000", 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1814000000000001e-05 2024-04-26T12:10:23.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.118675+0000", 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2809999999999997e-06 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.122613+0000", 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039384290000000002 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.122730+0000", 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011680600000000001 2024-04-26T12:10:23.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.122871+0000", 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014025600000000001 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.125528+0000", 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026574440000000001 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.133007+0000", 2024-04-26T12:10:23.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0074791440000000001 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.133043+0000", 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5876e-05 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.133079+0000", 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5678e-05 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:23.313 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:23.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:23.315 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:23.314+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:23.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:23.416 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:23.415+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:23.487 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:23.496 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:23.496 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:23.509 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:23.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:23.516 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:23.515+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:23.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:23.531 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:23.531 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:23.531 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:23.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 11 16 39397 39381 223.729 173.938 0.00377115 0.00446565 2024-04-26T12:10:23.617 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:23.616+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:23.693 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:23.693 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:23.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:23.718 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:23.717+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:23.819 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:23.818+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:23.884 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:23.885 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:23.899 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:23.920 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:23.919+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:23.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:10:24.021 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.020+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.075 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:24.075 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:24.089 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:24.122 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.121+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.223 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.222+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.265 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:24.265 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:24.278 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:24.324 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:24.323+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:24.425 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.424+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.454 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:24.454 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:24.467 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:24.528 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.526+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 12 16 41961 41945 218.438 160.25 0.0082657 0.00457405 2024-04-26T12:10:24.628 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.626+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.629 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:24.629 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:24.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:24.729 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:24.728+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:24.829 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:24.828+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:24.878 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:24.878 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:24.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:24.939 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:24.938+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:10:25.031 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:25.030+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:25.081 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:25.081 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:25.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:25.132 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:25.131+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:25.233 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:25.232+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:25.278 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:25.279 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:25.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:25.337 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:25.336+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:25.435 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:25.434+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:25.469 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:25.469 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:25.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:25.535 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:25.534+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:25.544 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:25.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 13 16 44628 44612 214.456 166.688 0.0093101 0.00465899 2024-04-26T12:10:25.635 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:25.634+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:25.705 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:25.705 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:25.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:25.723 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:25.745 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:25.765 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:25.764+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:25.766 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:25.767 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:25.767 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:25.768 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:25.838 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:25.837+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45411 5.e 5:74f03581:::benchmark_data_smithi045_43640_object45410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.891363+0000", 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0064622619999999999, 2024-04-26T12:10:25.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0064932549999999999, 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45411 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891363+0000", 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891363+0000", 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891362+0000", 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891439+0000", 2024-04-26T12:10:25.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6655000000000004e-05 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891448+0000", 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0699999999999996e-06 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891453+0000", 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891487+0000", 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4249999999999999e-05 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891580+0000", 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2106000000000002e-05 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.891657+0000", 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7340000000000002e-05 2024-04-26T12:10:25.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.895676+0000", 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040196310000000001 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45415 5.e 5:7336b8a4:::benchmark_data_smithi045_43640_object45414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.893151+0000", 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0046742789999999999, 2024-04-26T12:10:25.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0047812530000000001, 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45415 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893151+0000", 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893151+0000", 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893150+0000", 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893217+0000", 2024-04-26T12:10:25.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7506e-05 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893227+0000", 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4809999999999995e-06 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893235+0000", 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7700000000000001e-06 2024-04-26T12:10:25.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893268+0000", 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2969000000000002e-05 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893350+0000", 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2348999999999994e-05 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.893433+0000", 2024-04-26T12:10:25.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2471000000000004e-05 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.895684+0000", 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022513440000000002 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45419 5.e 5:7a7a59f0:::benchmark_data_smithi045_43640_object45418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.894365+0000", 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0034605339999999999, 2024-04-26T12:10:25.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036200429999999999, 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45419 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894365+0000", 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894365+0000", 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894364+0000", 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894429+0000", 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5271000000000006e-05 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894438+0000", 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894446+0000", 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5510000000000002e-06 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894502+0000", 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894588+0000", 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6873999999999995e-05 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.894666+0000", 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7544000000000002e-05 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.895975+0000", 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013092080000000001 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.913 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45424 5.b 5:d82315bf:::benchmark_data_smithi045_43640_object45423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.896898+0000", 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00092685599999999999, 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001149817, 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:25.914 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45424 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.896898+0000", 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.896898+0000", 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.896898+0000", 2024-04-26T12:10:25.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897006+0000", 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000108868 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897015+0000", 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5329999999999994e-06 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897022+0000", 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0960000000000003e-06 2024-04-26T12:10:25.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897050+0000", 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8274000000000001e-05 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897137+0000", 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7102999999999996e-05 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897217+0000", 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9579000000000005e-05 2024-04-26T12:10:25.917 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:45421 5.9 e24/17 5:90ec9d78:::benchmark_data_smithi045_43640_object45420:head v 24'2816, mlcod=24'2814)", 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.897165+0000", 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00066066599999999997, 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00093835499999999998, 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897165+0000", 2024-04-26T12:10:25.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897165+0000", 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897164+0000", 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897228+0000", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4190999999999996e-05 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897236+0000", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3599999999999998e-06 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897241+0000", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6860000000000003e-06 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897267+0000", 2024-04-26T12:10:25.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6013e-05 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897280+0000", 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2459999999999999e-05 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45425 5.d 5:bb1c5bac:::benchmark_data_smithi045_43640_object45424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.897885+0000", 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9999404, 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00025869000000000001, 2024-04-26T12:10:25.921 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45425 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897885+0000", 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897885+0000", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897884+0000", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897950+0000", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6047e-05 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897958+0000", 2024-04-26T12:10:25.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7919999999999993e-06 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.897965+0000", 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6139999999999997e-06 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898008+0000", 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3245999999999999e-05 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898135+0000", 2024-04-26T12:10:25.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127429 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45426 5.4 5:291b15b1:::benchmark_data_smithi045_43640_object45425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.898039+0000", 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997869, 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014558799999999999, 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:25.925 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45426 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898039+0000", 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898039+0000", 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898038+0000", 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898103+0000", 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4636999999999998e-05 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898110+0000", 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5769999999999996e-06 2024-04-26T12:10:25.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898116+0000", 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.071e-06 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.898159+0000", 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2403e-05 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:25.928 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 7 2024-04-26T12:10:25.929 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:25.930 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:25.939 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:25.938+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:26.040 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:26.039+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:26.142 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:26.141+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:26.142 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:26.142 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:26.142 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:26.143 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:26.143 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:26.157 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:26.242 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:26.240+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:26.342 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:26.341+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:26.375 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:26.375 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:26.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 37.005699280999998, 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013096059, 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.376 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:26.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366758+0000", 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366763+0000", 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4530000000000001e-06 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366772+0000", 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.251e-06 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.366783+0000", 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0886999999999999e-05 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370530+0000", 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037465969999999999 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370615+0000", 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5364999999999993e-05 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.370790+0000", 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017513300000000001 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.373719+0000", 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002928614 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379758+0000", 2024-04-26T12:10:26.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060387740000000002 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379803+0000", 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5123999999999997e-05 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:09:49.379854+0000", 2024-04-26T12:10:26.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1637e-05 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8885 5.0 5:05f43a42:::benchmark_data_smithi045_43640_object8884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.122053027, 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013442571, 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8885 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250405+0000", 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250404+0000", 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250440+0000", 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6013000000000002e-05 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250450+0000", 2024-04-26T12:10:26.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9969999999999993e-06 2024-04-26T12:10:26.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250456+0000", 2024-04-26T12:10:26.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9009999999999999e-06 2024-04-26T12:10:26.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250484+0000", 2024-04-26T12:10:26.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8342000000000001e-05 2024-04-26T12:10:26.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250567+0000", 2024-04-26T12:10:26.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2417999999999996e-05 2024-04-26T12:10:26.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250649+0000", 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2315e-05 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251244+0000", 2024-04-26T12:10:26.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00059499200000000003 2024-04-26T12:10:26.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263693+0000", 2024-04-26T12:10:26.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012449276 2024-04-26T12:10:26.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263774+0000", 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0716000000000004e-05 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.263847+0000", 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3318999999999994e-05 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.391 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8887 5.4 5:2f729b2c:::benchmark_data_smithi045_43640_object8886:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.121546273, 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013197943, 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.392 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8887 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250911+0000", 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.250910+0000", 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251023+0000", 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112483 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251033+0000", 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0395e-05 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251041+0000", 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4150000000000002e-06 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251082+0000", 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0892000000000001e-05 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251182+0000", 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100005 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251313+0000", 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013093999999999999 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.252305+0000", 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00099206800000000003 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264059+0000", 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011754114 2024-04-26T12:10:26.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264088+0000", 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9246000000000001e-05 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264109+0000", 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1291e-05 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:8894 5.b 5:d28e84bb:::benchmark_data_smithi045_43640_object8893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.121050809, 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013316091, 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 8894 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251407+0000", 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251406+0000", 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251547+0000", 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141116 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251556+0000", 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3089999999999996e-06 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251563+0000", 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5399999999999998e-06 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251601+0000", 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7861999999999998e-05 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251717+0000", 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000115507 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.251848+0000", 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131252 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.253099+0000", 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001251252 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264673+0000", 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011573603 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264703+0000", 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0605999999999998e-05 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:14.264723+0000", 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9544000000000001e-05 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18435 5.b 5:d1429ed2:::benchmark_data_smithi045_43640_object18434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.6113146280000006, 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013538150000000001, 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.404 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18435 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761143+0000", 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761142+0000", 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761199+0000", 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6650999999999997e-05 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761206+0000", 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.391e-06 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761211+0000", 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8380000000000001e-06 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761236+0000", 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4709999999999999e-05 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761314+0000", 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8343000000000005e-05 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761398+0000", 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3653999999999996e-05 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762811+0000", 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014135840000000001 2024-04-26T12:10:26.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774484+0000", 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011672561 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774626+0000", 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014174500000000001 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774681+0000", 2024-04-26T12:10:26.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5495000000000003e-05 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18436 5.8 5:171915a6:::benchmark_data_smithi045_43640_object18435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.6112408499999997, 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013344784, 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.410 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18436 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761217+0000", 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761216+0000", 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761311+0000", 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4912000000000002e-05 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761317+0000", 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5500000000000002e-06 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761321+0000", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6559999999999998e-06 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761355+0000", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4289999999999999e-05 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761462+0000", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106743 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761550+0000", 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8185999999999999e-05 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762740+0000", 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011899250000000001 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774429+0000", 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011689643 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774508+0000", 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8405999999999994e-05 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.774562+0000", 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3811999999999999e-05 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18443 5.e 5:7a1f377a:::benchmark_data_smithi045_43640_object18442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.6107866860000009, 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013395112000000001, 2024-04-26T12:10:26.415 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18443 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761671+0000", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761670+0000", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761698+0000", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7858e-05 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761716+0000", 2024-04-26T12:10:26.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761722+0000", 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0140000000000004e-06 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761764+0000", 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2364999999999998e-05 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.761883+0000", 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119024 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762031+0000", 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014787000000000001 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763327+0000", 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012958309999999999 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775010+0000", 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011683037 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775034+0000", 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4496999999999999e-05 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.775066+0000", 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1890999999999997e-05 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:18445 5.4 5:2b1a26ab:::benchmark_data_smithi045_43640_object18444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.6096041539999995, 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014248856000000001, 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 18445 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762853+0000", 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762903+0000", 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0436999999999998e-05 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762912+0000", 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5790000000000004e-06 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762919+0000", 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.762960+0000", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1046e-05 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763044+0000", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3788999999999993e-05 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763132+0000", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8162000000000001e-05 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.763995+0000", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00086267500000000003 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777026+0000", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013031093000000001 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777068+0000", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1953000000000003e-05 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:16.777102+0000", 2024-04-26T12:10:26.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4746000000000002e-05 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22165 5.0 5:052deb84:::benchmark_data_smithi045_43640_object22164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.5209153180000001, 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013303288999999999, 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.426 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22165 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851542+0000", 2024-04-26T12:10:26.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851674+0000", 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000132664 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851683+0000", 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2930000000000001e-06 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851690+0000", 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3699999999999997e-06 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852246+0000", 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00055546700000000003 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852392+0000", 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014629700000000001 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852555+0000", 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016261699999999999 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854109+0000", 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001554656 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864757+0000", 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010647439999999999 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864802+0000", 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5751999999999998e-05 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864846+0000", 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3238999999999997e-05 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:22167 5.8 5:13422a89:::benchmark_data_smithi045_43640_object22166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.5207616060000007, 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01318099, 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 22167 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851696+0000", 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851695+0000", 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851813+0000", 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117843 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851821+0000", 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.661e-06 2024-04-26T12:10:26.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.851827+0000", 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1789999999999996e-06 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852237+0000", 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00041010299999999999 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852404+0000", 2024-04-26T12:10:26.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000167195 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.852582+0000", 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017714099999999999 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.854116+0000", 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001534856 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864794+0000", 2024-04-26T12:10:26.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010677246 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864841+0000", 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7003999999999999e-05 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:17.864877+0000", 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6338999999999999e-05 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34842 5.b 5:d6f421a9:::benchmark_data_smithi045_43640_object34841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.3913964480000001, 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014832164, 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34842 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981194+0000", 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013305899999999999 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981201+0000", 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4440000000000002e-06 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981207+0000", 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1689999999999997e-06 2024-04-26T12:10:26.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982376+0000", 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001168531 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982492+0000", 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116359 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982618+0000", 2024-04-26T12:10:26.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000125387 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.984635+0000", 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020174680000000001 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995828+0000", 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011192366 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995871+0000", 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3260000000000003e-05 2024-04-26T12:10:26.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995893+0000", 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2554000000000001e-05 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34848 5.4 5:2a4916b0:::benchmark_data_smithi045_43640_object34847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.3911205899999999, 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014588217000000001, 2024-04-26T12:10:26.442 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34848 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981465+0000", 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012813200000000001 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981473+0000", 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6470000000000004e-06 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981480+0000", 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5200000000000003e-06 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982512+0000", 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010321250000000001 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982619+0000", 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107509 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982736+0000", 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116821 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.985587+0000", 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002851124 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995838+0000", 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010250987 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995889+0000", 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0865999999999997e-05 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995925+0000", 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5991999999999997e-05 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.447 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34849 5.8 5:19ff06c8:::benchmark_data_smithi045_43640_object34848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.982109+0000", 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.3903486320000003, 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013794107999999999, 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34849 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.448 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982109+0000", 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982109+0000", 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982108+0000", 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982137+0000", 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8994000000000001e-05 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982147+0000", 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6569999999999992e-06 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982154+0000", 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9480000000000002e-06 2024-04-26T12:10:26.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982194+0000", 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9852999999999999e-05 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982307+0000", 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112946 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982445+0000", 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013894800000000001 2024-04-26T12:10:26.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.985056+0000", 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026107000000000001 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995808+0000", 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010751449 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995863+0000", 2024-04-26T12:10:26.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5837000000000001e-05 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995903+0000", 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9620999999999999e-05 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:38062 5.b 5:d4036f5e:::benchmark_data_smithi045_43640_object38061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:23.112642+0000", 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.259815423, 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013190561, 2024-04-26T12:10:26.453 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 38062 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112642+0000", 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112642+0000", 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112642+0000", 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112718+0000", 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6686000000000004e-05 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112726+0000", 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9580000000000007e-06 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112733+0000", 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5420000000000002e-06 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112774+0000", 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1242999999999998e-05 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.112897+0000", 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000122939 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.113023+0000", 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012632499999999999 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.115928+0000", 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029048889999999999 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.125760+0000", 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0098322289999999996 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.125798+0000", 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8037000000000002e-05 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:23.125833+0000", 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4319000000000001e-05 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.458 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45538 5.e 5:7a9275ef:::benchmark_data_smithi045_43640_object45537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.936438+0000", 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.43601968899999999, 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013601212, 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45538 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.459 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.936438+0000", 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.936438+0000", 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.936437+0000", 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.936482+0000", 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4903e-05 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.936487+0000", 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0309999999999998e-06 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.936492+0000", 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4390000000000002e-06 2024-04-26T12:10:26.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.937649+0000", 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011567400000000001 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.937776+0000", 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012730799999999999 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.937934+0000", 2024-04-26T12:10:26.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000158154 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.939217+0000", 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001282608 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.949965+0000", 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010748275 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.949995+0000", 2024-04-26T12:10:26.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0110000000000001e-05 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.950039+0000", 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4085999999999998e-05 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45554 5.e 5:7a7db317:::benchmark_data_smithi045_43640_object45553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.43090250299999999, 2024-04-26T12:10:26.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01544209, 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45554 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941613+0000", 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8433000000000001e-05 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941618+0000", 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5010000000000004e-06 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941622+0000", 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941714+0000", 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1539000000000006e-05 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941814+0000", 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010071 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941945+0000", 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013045099999999999 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.942986+0000", 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001041401 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.956912+0000", 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013925379 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.956960+0000", 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8199999999999999e-05 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.956997+0000", 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7317000000000002e-05 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.469 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45711 5.8 5:1b48ef21:::benchmark_data_smithi045_43640_object45710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.005780+0000", 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.366677433, 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013064688, 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45711 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.470 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.005780+0000", 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.005780+0000", 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.005780+0000", 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.005816+0000", 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6702999999999997e-05 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.005822+0000", 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4330000000000003e-06 2024-04-26T12:10:26.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.005826+0000", 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1389999999999997e-06 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.007595+0000", 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001769465 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.007680+0000", 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4246000000000006e-05 2024-04-26T12:10:26.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.007768+0000", 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8245000000000006e-05 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.010054+0000", 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022867080000000001 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.018768+0000", 2024-04-26T12:10:26.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0087135089999999995 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.018804+0000", 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6298999999999999e-05 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.018845+0000", 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0598e-05 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:46551 5.4 5:21762b67:::benchmark_data_smithi045_43640_object46550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.322863+0000", 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.049594434, 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013726110999999999, 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 46551 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322863+0000", 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322863+0000", 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322863+0000", 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322887+0000", 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3873e-05 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322894+0000", 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4529999999999996e-06 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322901+0000", 2024-04-26T12:10:26.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5769999999999999e-06 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.325883+0000", 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029824220000000002 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.325973+0000", 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0192999999999995e-05 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.326063+0000", 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9810999999999998e-05 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.329929+0000", 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0038663389999999999 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.336494+0000", 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065646389999999997 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.336543+0000", 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8477999999999999e-05 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.336589+0000", 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6789000000000002e-05 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:46552 5.4 5:2669dbb5:::benchmark_data_smithi045_43640_object46551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.322972+0000", 2024-04-26T12:10:26.481 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.049485142000000003, 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01375473, 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 46552 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322972+0000", 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322972+0000", 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.322972+0000", 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.323105+0000", 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013286400000000001 2024-04-26T12:10:26.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.323110+0000", 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1540000000000001e-06 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.323114+0000", 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.754e-06 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.327196+0000", 2024-04-26T12:10:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040824579999999997 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.327288+0000", 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1459999999999995e-05 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.327369+0000", 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1298000000000007e-05 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.331140+0000", 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037708350000000002 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.336640+0000", 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0054999669999999997 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.336687+0000", 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6657999999999999e-05 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.336727+0000", 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:46628 5.e 5:78c4d412:::benchmark_data_smithi045_43640_object46627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.022012232, 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014366868, 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:26.487 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 46628 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:26.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350494+0000", 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9835e-05 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350507+0000", 2024-04-26T12:10:26.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2798e-05 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350516+0000", 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1339999999999993e-06 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.353559+0000", 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003042927 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.353653+0000", 2024-04-26T12:10:26.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3852999999999997e-05 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.353737+0000", 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3846999999999999e-05 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.354711+0000", 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00097387899999999998 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.364745+0000", 2024-04-26T12:10:26.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010034569 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.364789+0000", 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3247000000000001e-05 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.364812+0000", 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3614000000000001e-05 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:26.492 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:26.493 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:26.494 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:26.493+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:26.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:26.595 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:26.594+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:26.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 14 16 47271 47255 210.936 165.188 0.00501905 0.00473657 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:47436 5.6 5:6662d3ea:::benchmark_data_smithi045_43640_object47435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.674932+0000", 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0037635350000000001, 2024-04-26T12:10:26.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0037993509999999999, 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 47436 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.674932+0000", 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.674932+0000", 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.674931+0000", 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675027+0000", 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6700000000000006e-05 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675037+0000", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4190000000000008e-06 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675043+0000", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8479999999999997e-06 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675079+0000", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6100999999999999e-05 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675202+0000", 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012375999999999999 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675332+0000", 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000129787 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47432 5.1 e24/17 5:85481c57:::benchmark_data_smithi045_43640_object47431:head v 24'2985, mlcod=24'2981)", 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.674945+0000", 2024-04-26T12:10:26.684 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003750209, 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003877704, 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.674945+0000", 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.674945+0000", 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.674945+0000", 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675076+0000", 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013127500000000001 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675081+0000", 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8389999999999997e-06 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675084+0000", 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6270000000000002e-06 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675121+0000", 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6751000000000001e-05 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675148+0000", 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7308e-05 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:47437 5.3 5:cc77a9ad:::benchmark_data_smithi045_43640_object47436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.675056+0000", 2024-04-26T12:10:26.688 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036391710000000001, 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038323540000000001, 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 47437 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675056+0000", 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675056+0000", 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675056+0000", 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675207+0000", 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015188300000000001 2024-04-26T12:10:26.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675212+0000", 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0300000000000001e-06 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675216+0000", 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675257+0000", 2024-04-26T12:10:26.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0521e-05 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675385+0000", 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000128097 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675566+0000", 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000181363 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:47438 5.a 5:50b18beb:::benchmark_data_smithi045_43640_object47437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.692 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.675223+0000", 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003472017, 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0037466140000000001, 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 47438 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675223+0000", 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675223+0000", 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675223+0000", 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675324+0000", 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000101186 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675329+0000", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2839999999999997e-06 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675333+0000", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9559999999999999e-06 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675368+0000", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4822e-05 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675528+0000", 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015986099999999999 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675672+0000", 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000144122 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678954+0000", 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0032826040000000002 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47440 5.2 e24/17 5:41094155:::benchmark_data_smithi045_43640_object47439:head v 24'2942, mlcod=24'2940)", 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.675406+0000", 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0032889769999999998, 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0036517680000000001, 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675406+0000", 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675406+0000", 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675406+0000", 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675488+0000", 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2113999999999993e-05 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675497+0000", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0820000000000005e-06 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675503+0000", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0510000000000002e-06 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675542+0000", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9045000000000003e-05 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675557+0000", 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4353e-05 2024-04-26T12:10:26.699 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:47446 5.3 5:ccf8c113:::benchmark_data_smithi045_43640_object47445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.675531+0000", 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00316439, 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035929780000000001, 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 47446 2024-04-26T12:10:26.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675531+0000", 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675531+0000", 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675530+0000", 2024-04-26T12:10:26.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675616+0000", 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6227e-05 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675625+0000", 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2509999999999994e-06 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675631+0000", 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677291+0000", 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016601700000000001 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677467+0000", 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017614 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:26.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677607+0000", 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013957600000000001 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47439 5.e e24/17 5:778d8e0b:::benchmark_data_smithi045_43640_object47438:head v 24'2958, mlcod=24'2956)", 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.675506+0000", 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031895859999999999, 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0036665510000000001, 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675506+0000", 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675506+0000", 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.675505+0000", 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676691+0000", 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011856169999999999 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676699+0000", 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.072e-06 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676705+0000", 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676928+0000", 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00022376000000000001 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676946+0000", 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7995e-05 2024-04-26T12:10:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47444 5.0 e24/17 5:010db6e2:::benchmark_data_smithi045_43640_object47443:head v 24'3006, mlcod=24'3004)", 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.676713+0000", 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001981933, 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024948930000000002, 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676713+0000", 2024-04-26T12:10:26.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676713+0000", 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676713+0000", 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676756+0000", 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3603999999999998e-05 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676763+0000", 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7900000000000002e-06 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676768+0000", 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.271e-06 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676805+0000", 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7017000000000002e-05 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676825+0000", 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9673999999999998e-05 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47445 5.4 e24/17 5:21e11a75:::benchmark_data_smithi045_43640_object47444:head v 24'3047, mlcod=24'3045)", 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.676779+0000", 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0019165009999999999, 2024-04-26T12:10:26.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024624109999999999, 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676779+0000", 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676779+0000", 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676778+0000", 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676807+0000", 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8532000000000001e-05 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676813+0000", 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3779999999999998e-06 2024-04-26T12:10:26.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676819+0000", 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9920000000000004e-06 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676885+0000", 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6124000000000006e-05 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.676901+0000", 2024-04-26T12:10:26.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5832e-05 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47450 5.1 e24/17 5:826d05c8:::benchmark_data_smithi045_43640_object47449:head v 24'2986, mlcod=24'2983)", 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.677432+0000", 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0012629270000000001, 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018417329999999999, 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677432+0000", 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677432+0000", 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677432+0000", 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677488+0000", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5954e-05 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677498+0000", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8640000000000008e-06 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677504+0000", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1789999999999996e-06 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:26.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677537+0000", 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3766000000000002e-05 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.677556+0000", 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8834999999999998e-05 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:47447 5.e e24/17)", 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.678196+0000", 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00049937400000000002, 2024-04-26T12:10:26.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001109114, 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678196+0000", 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678196+0000", 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:26.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678195+0000", 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678219+0000", 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3271000000000001e-05 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678227+0000", 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4440000000000008e-06 2024-04-26T12:10:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.678234+0000", 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.759e-06 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 11 2024-04-26T12:10:26.721 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:26.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:26.723 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:26.721+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:26.824 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:26.823+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:26.925 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:26.923+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:26.954 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:26.954 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:26.954 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:26.954 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:26.954 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:26.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:10:26.968 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:27.026 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:27.024+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:27.128 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:27.125+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:27.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:10:27.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:27.147 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:10:27.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.825711771000002, 2024-04-26T12:10:27.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016256112, 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365793+0000", 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999952 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365806+0000", 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3039e-05 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365819+0000", 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3132000000000001e-05 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365834+0000", 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365953+0000", 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011895700000000001 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375316+0000", 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093566369999999992 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375394+0000", 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7732999999999996e-05 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375472+0000", 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8182999999999993e-05 2024-04-26T12:10:27.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381062+0000", 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055902030000000002 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381964+0000", 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090143000000000005 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382012+0000", 2024-04-26T12:10:27.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8192999999999998e-05 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382054+0000", 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1936e-05 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.825650185000001, 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016298395, 2024-04-26T12:10:27.201 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365858+0000", 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365864+0000", 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365873+0000", 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365882+0000", 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4989999999999994e-06 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366075+0000", 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019275499999999999 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366080+0000", 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375717+0000", 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096367499999999995 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375784+0000", 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6649000000000005e-05 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375898+0000", 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011433 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381103+0000", 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052053610000000004 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382076+0000", 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097246799999999999 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382121+0000", 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5714999999999999e-05 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382158+0000", 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6174999999999998e-05 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.825622015999997, 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:27.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:27.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.825549678000002, 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:27.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.825519143000001, 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016265910000000001, 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.219 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:27.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365994+0000", 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366006+0000", 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1816e-05 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366011+0000", 2024-04-26T12:10:27.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368181+0000", 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021698279999999999 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368185+0000", 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4900000000000002e-06 2024-04-26T12:10:27.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376058+0000", 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078721069999999997 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376139+0000", 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0958000000000007e-05 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376224+0000", 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5680000000000006e-05 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381953+0000", 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057284379999999998 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382171+0000", 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021846100000000001 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382221+0000", 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9869e-05 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382256+0000", 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5182999999999998e-05 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.825282975999997, 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01469869, 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366226+0000", 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366232+0000", 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1530000000000002e-06 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366243+0000", 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1103e-05 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366260+0000", 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7493999999999999e-05 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368532+0000", 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022716699999999999 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368538+0000", 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9270000000000002e-06 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373128+0000", 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045899799999999996 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.373834+0000", 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00070583699999999996 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.374269+0000", 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00043562499999999998 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380083+0000", 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0058130949999999999 2024-04-26T12:10:27.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380821+0000", 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00073799399999999995 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380880+0000", 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9001e-05 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.380925+0000", 2024-04-26T12:10:27.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5617e-05 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 37.823864035, 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015300935, 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367648+0000", 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.659e-06 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367657+0000", 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367667+0000", 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368391+0000", 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072424000000000002 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368397+0000", 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6389999999999997e-06 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377728+0000", 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093318099999999994 2024-04-26T12:10:27.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377867+0000", 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013898 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382946+0000", 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050788350000000003 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18434 5.c 5:3c132dfb:::benchmark_data_smithi045_43640_object18433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.43047696, 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014988885, 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18434 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761032+0000", 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761099+0000", 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7621999999999997e-05 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761107+0000", 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.306e-06 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761113+0000", 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8499999999999999e-06 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761148+0000", 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5754999999999999e-05 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761273+0000", 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000124139 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761402+0000", 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012899799999999999 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.774898+0000", 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013496144 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.775945+0000", 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010469100000000001 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.775986+0000", 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1459999999999999e-05 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776021+0000", 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5305999999999997e-05 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18438 5.c 5:300cc216:::benchmark_data_smithi045_43640_object18437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.430256913000001, 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014878529999999999, 2024-04-26T12:10:27.242 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18438 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:27.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761252+0000", 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761319+0000", 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7223000000000003e-05 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761325+0000", 2024-04-26T12:10:27.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7150000000000003e-06 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761329+0000", 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9430000000000002e-06 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.762964+0000", 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016356090000000001 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.763091+0000", 2024-04-26T12:10:27.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000126494 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.763236+0000", 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014511999999999999 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.774944+0000", 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011708260999999999 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776031+0000", 2024-04-26T12:10:27.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001086762 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776076+0000", 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4594e-05 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776131+0000", 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5373e-05 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.247 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18440 5.c 5:367b11b7:::benchmark_data_smithi045_43640_object18439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.430174124000001, 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015638973, 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18440 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:27.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761462+0000", 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012686699999999999 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761469+0000", 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1770000000000001e-06 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761475+0000", 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7479999999999999e-06 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773562+0000", 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012087044999999999 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773709+0000", 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014781500000000001 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773863+0000", 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015342099999999999 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776173+0000", 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023097959999999998 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776895+0000", 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072276100000000004 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776938+0000", 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2503999999999998e-05 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776974+0000", 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6337999999999997e-05 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:37890 5.a 5:586d3755:::benchmark_data_smithi045_43640_object37889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.1492761509999996, 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015306492999999999, 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.253 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 37890 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042281+0000", 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8075000000000003e-05 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042288+0000", 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2289999999999997e-06 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042294+0000", 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0929999999999999e-06 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044619+0000", 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023244060000000002 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044746+0000", 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012727499999999999 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044888+0000", 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014250800000000001 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.047298+0000", 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002409797 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057491+0000", 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010193160999999999 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057519+0000", 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.758e-05 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057540+0000", 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0908999999999999e-05 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45154 5.5 5:a06af483:::benchmark_data_smithi045_43640_object45153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.258 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.4057492149999999, 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016862312000000001, 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45154 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785759+0000", 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785855+0000", 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6248000000000004e-05 2024-04-26T12:10:27.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785865+0000", 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2569999999999996e-06 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785872+0000", 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1579999999999999e-06 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785914+0000", 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1968000000000002e-05 2024-04-26T12:10:27.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786045+0000", 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000131407 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786145+0000", 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000100283 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792782+0000", 2024-04-26T12:10:27.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066362549999999998 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802539+0000", 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0097571619999999998 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802585+0000", 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802623+0000", 2024-04-26T12:10:27.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7979999999999999e-05 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45157 5.5 5:a12746f8:::benchmark_data_smithi045_43640_object45156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.787152+0000", 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.4043572740000001, 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015548606, 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45157 2024-04-26T12:10:27.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787152+0000", 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787152+0000", 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787151+0000", 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787254+0000", 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010309100000000001 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787267+0000", 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2164000000000001e-05 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787274+0000", 2024-04-26T12:10:27.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4139999999999997e-06 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.789905+0000", 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026313410000000001 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.790055+0000", 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014931100000000001 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.790196+0000", 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014171 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792823+0000", 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026264489999999999 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802631+0000", 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098082719999999998 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802670+0000", 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9193000000000002e-05 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802701+0000", 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0548e-05 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:45554 5.e e24/17 5:7a7db317:::benchmark_data_smithi045_43640_object45553:head v 24'2833, mlcod=24'2826)", 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.941989+0000", 2024-04-26T12:10:27.269 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.2495208469999999, 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014673871, 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.941989+0000", 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.941989+0000", 2024-04-26T12:10:27.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.941988+0000", 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.942052+0000", 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4523999999999994e-05 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.942062+0000", 2024-04-26T12:10:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8320000000000001e-06 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.942069+0000", 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7819999999999996e-06 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.946948+0000", 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048785149999999999 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.946966+0000", 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8389999999999998e-05 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.956629+0000", 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096624859999999996 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.956662+0000", 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3927000000000002e-05 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:46885 5.c 5:3064f018:::benchmark_data_smithi045_43640_object46884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.449435+0000", 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.74207471000000003, 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015152501000000001, 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 46885 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449435+0000", 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449435+0000", 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449434+0000", 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449514+0000", 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0054000000000003e-05 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449525+0000", 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449532+0000", 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.503e-06 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.456390+0000", 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006857546 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.456521+0000", 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013151499999999999 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.456653+0000", 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013129999999999999 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.460529+0000", 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038763909999999999 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.464512+0000", 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039826979999999998 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.464554+0000", 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1702000000000002e-05 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.464587+0000", 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3637000000000003e-05 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48065 5.e e24/17 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head v 24'3006, mlcod=24'3001)", 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.927627+0000", 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.26388249400000002, 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015599573, 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927627+0000", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927627+0000", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927626+0000", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927693+0000", 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6991999999999998e-05 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927701+0000", 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3669999999999999e-06 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927711+0000", 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0225e-05 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.928111+0000", 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00040030600000000001 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.928130+0000", 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8923000000000002e-05 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.943189+0000", 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015058821 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.943226+0000", 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7400000000000001e-05 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48079 5.e e24/17 5:7d42ec23:::benchmark_data_smithi045_43640_object48078:head v 24'3009, mlcod=24'3002)", 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.933403+0000", 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.258106261, 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014778807999999999, 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.933403+0000", 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.933403+0000", 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.933403+0000", 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.933454+0000", 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1476e-05 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.933461+0000", 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0099999999999998e-06 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.933466+0000", 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6020000000000002e-06 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.935250+0000", 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0017844169999999999 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.935267+0000", 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7113999999999999e-05 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.948143+0000", 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012876064 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.948182+0000", 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8736000000000003e-05 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48201 5.1 e24/17 5:8834a6b2:::benchmark_data_smithi045_43640_object48200:head v 24'3025, mlcod=24'3023)", 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.20527077199999999, 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016625150000000002, 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986238+0000", 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986342+0000", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104341 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986351+0000", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1980000000000001e-06 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986357+0000", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.443e-06 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986391+0000", 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3862999999999997e-05 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986404+0000", 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3036e-05 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002828+0000", 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016424294999999998 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002864+0000", 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.561e-05 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48204 5.4 e24/17 5:2e474d3f:::benchmark_data_smithi045_43640_object48203:head v 24'3083, mlcod=24'3081)", 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.20429209600000001, 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015725810999999999, 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987246+0000", 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8785e-05 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987253+0000", 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987259+0000", 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987294+0000", 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5101000000000002e-05 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987314+0000", 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9874e-05 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002909+0000", 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015595565 2024-04-26T12:10:27.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002943+0000", 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3633000000000001e-05 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48206 5.1 e24/17 5:80754ec1:::benchmark_data_smithi045_43640_object48205:head v 24'3026, mlcod=24'3023)", 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.987842+0000", 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.20366701200000001, 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015042574, 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.295 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987842+0000", 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987842+0000", 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987842+0000", 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987909+0000", 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7422999999999995e-05 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987917+0000", 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987923+0000", 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:10:27.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987954+0000", 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0666000000000001e-05 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987970+0000", 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.624e-05 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002867+0000", 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0148974 2024-04-26T12:10:27.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002885+0000", 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7787000000000001e-05 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:27.299 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:27.300 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:27.298+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:27.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:27.401 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:27.400+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:27.475 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49355 5.7 5:e2a588fa:::benchmark_data_smithi045_43640_object49354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.465391+0000", 2024-04-26T12:10:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0086349349999999998, 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008655879, 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49355 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465391+0000", 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465391+0000", 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465390+0000", 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465446+0000", 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6019e-05 2024-04-26T12:10:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465456+0000", 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7569999999999999e-06 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465463+0000", 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3200000000000002e-06 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467147+0000", 2024-04-26T12:10:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00168362 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467288+0000", 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141211 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467429+0000", 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014095700000000001 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.471862+0000", 2024-04-26T12:10:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044327910000000002 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49359 5.7 5:e31551bf:::benchmark_data_smithi045_43640_object49358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.465737+0000", 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0082891170000000004, 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083652759999999996, 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49359 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465737+0000", 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465737+0000", 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465736+0000", 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465802+0000", 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6246000000000002e-05 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465811+0000", 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4309999999999994e-06 2024-04-26T12:10:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465824+0000", 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2798e-05 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.469051+0000", 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003227302 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.469194+0000", 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142898 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.469332+0000", 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013863600000000001 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.471872+0000", 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025393429999999999 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49360 5.7 5:e24a49fd:::benchmark_data_smithi045_43640_object49359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.465831+0000", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0081954899999999997, 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083186279999999998, 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49360 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465831+0000", 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465831+0000", 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465830+0000", 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465865+0000", 2024-04-26T12:10:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5271999999999997e-05 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465874+0000", 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9900000000000003e-06 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.465881+0000", 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2099999999999998e-06 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.470583+0000", 2024-04-26T12:10:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047020810000000003 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.470723+0000", 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140402 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.470862+0000", 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013873999999999999 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473451+0000", 2024-04-26T12:10:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025891769999999998 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49363 5.2 5:4910a776:::benchmark_data_smithi045_43640_object49362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.467659+0000", 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.006367518, 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065370840000000003, 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49363 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467659+0000", 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467659+0000", 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467658+0000", 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467761+0000", 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103711 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467787+0000", 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5907000000000001e-05 2024-04-26T12:10:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467799+0000", 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1464999999999999e-05 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467835+0000", 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.467940+0000", 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105442 2024-04-26T12:10:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468064+0000", 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012408300000000001 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.471176+0000", 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031113460000000001 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49366 5.2 5:4d32be39:::benchmark_data_smithi045_43640_object49365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.468321+0000", 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0057052120000000003, 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059191239999999996, 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49366 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468321+0000", 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468321+0000", 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468320+0000", 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468391+0000", 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0691999999999993e-05 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468400+0000", 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0240000000000003e-06 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.468407+0000", 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7839999999999998e-06 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.469601+0000", 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001193946 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.469729+0000", 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012859699999999999 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.469867+0000", 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000138205 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.471831+0000", 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019637209999999999 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49373 5.2 5:44f408ac:::benchmark_data_smithi045_43640_object49372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.473544+0000", 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00048208700000000002, 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074042800000000001, 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49373 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473544+0000", 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473544+0000", 2024-04-26T12:10:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473543+0000", 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473601+0000", 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7590000000000003e-05 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473609+0000", 2024-04-26T12:10:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6230000000000003e-06 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473615+0000", 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5720000000000002e-06 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473640+0000", 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4822999999999999e-05 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473725+0000", 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5557999999999996e-05 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473818+0000", 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2786000000000002e-05 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:49371 5.5 e24/17 5:a408445f:::benchmark_data_smithi045_43640_object49370:head v 24'3031, mlcod=24'3029)", 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.473674+0000", 2024-04-26T12:10:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00035183399999999998, 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00065166599999999996, 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473674+0000", 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473674+0000", 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473674+0000", 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473734+0000", 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0334000000000002e-05 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473740+0000", 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4299999999999997e-06 2024-04-26T12:10:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473744+0000", 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4870000000000004e-06 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473778+0000", 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3698000000000002e-05 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473802+0000", 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3988000000000001e-05 2024-04-26T12:10:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:49372 5.c e24/17 5:32f94578:::benchmark_data_smithi045_43640_object49371:head v 24'3117, mlcod=24'3115)", 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.473757+0000", 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.000269621, 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060212500000000001, 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473757+0000", 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473757+0000", 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473756+0000", 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473798+0000", 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1884000000000001e-05 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473804+0000", 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.212e-06 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473809+0000", 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7829999999999998e-06 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473847+0000", 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8040000000000002e-05 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.473866+0000", 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8967999999999999e-05 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 8 2024-04-26T12:10:27.509 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:27.511 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:27.509+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:27.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:27.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:27.533 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 24, 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "238e0384-60e0-4b21-9d3a-782265888521", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2024-04-26T12:09:34.034413+0000", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2024-04-26T12:10:24.929372+0000", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2024-04-26T12:09:41.810744+0000", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2024-04-26T12:09:34.969233+0000", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5806080, 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "nodeep-scrub", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "noscrub", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2024-04-26T12:10:27.534 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 5, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 3, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2024-04-26T12:10:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:42.899365+0000", 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:27.536 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "11", 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:27.538 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2024-04-26T12:10:27.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:42.935107+0000", 2024-04-26T12:10:27.541 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2024-04-26T12:10:27.542 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "12", 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:27.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:27.544 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:27.545 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:27.546 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 3, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:47.482562+0000", 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:27.547 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2024-04-26T12:10:27.548 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "15", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:27.549 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:27.550 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:27.551 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.552 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 4, 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:09:48.344147+0000", 2024-04-26T12:10:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2024-04-26T12:10:27.554 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "16", 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:27.555 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:27.556 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:27.557 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.558 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 5, 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "unique_pool_0", 2024-04-26T12:10:27.559 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2024-04-26T12:10:10.173361+0000", 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 16, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 16, 2024-04-26T12:10:27.560 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 16, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 16, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 16, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "19", 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:10:27.561 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2024-04-26T12:10:27.562 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:10:27.563 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "rados": {} 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:10:27.564 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "f5e89d15-234b-43fa-a34c-aa6987125af4", 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:27.565 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 18, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6800", 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.566 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6801", 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6802", 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6803", 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6806", 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.568 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6807", 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6804", 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.569 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.71:6805", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40435 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.71:6801/40435", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.71:6803/40435", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.71:6807/40435", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.71:6805/40435", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:27.570 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "cacdbf9c-7e2f-46fa-9e34-804a2afdb53a", 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 17, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:27.571 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6800", 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6801", 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:27.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6802", 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6803", 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:27.573 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6806", 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6807", 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.574 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6804", 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.94:6805", 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40365 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.94:6801/40365", 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.94:6803/40365", 2024-04-26T12:10:27.575 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.94:6807/40365", 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.94:6805/40365", 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "406b2884-83cb-4c28-885d-e6f9a3d25330", 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2024-04-26T12:10:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 8, 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 17, 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6800", 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6801", 2024-04-26T12:10:27.577 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6802", 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6803", 2024-04-26T12:10:27.578 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6806", 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6807", 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.579 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6804", 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.104:6805", 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 40673 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.580 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.104:6801/40673", 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.104:6803/40673", 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.104:6807/40673", 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.104:6805/40673", 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.581 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.032022+0000", 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:27.582 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.017304+0000", 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2024-04-26T12:09:40.048371+0000", 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.583 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [ 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "3.1d", 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: 0, 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: 1 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2024-04-26T12:10:27.584 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2024-04-26T12:10:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2024-04-26T12:10:27.586 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2024-04-26T12:10:27.586 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:10:27.586 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:10:27.586 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2024-04-26T12:10:27.586 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-04-26T12:10:27.586 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:10:27.587 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': '238e0384-60e0-4b21-9d3a-782265888521', 'created': '2024-04-26T12:09:34.034413+0000', 'modified': '2024-04-26T12:10:24.929372+0000', 'last_up_change': '2024-04-26T12:09:41.810744+0000', 'last_in_change': '2024-04-26T12:09:34.969233+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:09:42.899365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:09:42.935107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:09:47.482562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:09:48.344147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T12:10:10.173361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f5e89d15-234b-43fa-a34c-aa6987125af4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6801', 'nonce': 40435}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 40435}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6807', 'nonce': 40435}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 40435}, {'type': 'v1', 'addr': '172.21.15.71:6805', 'nonce': 40435}]}, 'public_addr': '172.21.15.71:6801/40435', 'cluster_addr': '172.21.15.71:6803/40435', 'heartbeat_back_addr': '172.21.15.71:6807/40435', 'heartbeat_front_addr': '172.21.15.71:6805/40435', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'cacdbf9c-7e2f-46fa-9e34-804a2afdb53a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6800', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6801', 'nonce': 40365}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6802', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6803', 'nonce': 40365}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6806', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6807', 'nonce': 40365}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6804', 'nonce': 40365}, {'type': 'v1', 'addr': '172.21.15.94:6805', 'nonce': 40365}]}, 'public_addr': '172.21.15.94:6801/40365', 'cluster_addr': '172.21.15.94:6803/40365', 'heartbeat_back_addr': '172.21.15.94:6807/40365', 'heartbeat_front_addr': '172.21.15.94:6805/40365', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '406b2884-83cb-4c28-885d-e6f9a3d25330', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6800', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6801', 'nonce': 40673}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6802', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6803', 'nonce': 40673}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6806', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6807', 'nonce': 40673}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6804', 'nonce': 40673}, {'type': 'v1', 'addr': '172.21.15.104:6805', 'nonce': 40673}]}, 'public_addr': '172.21.15.104:6801/40673', 'cluster_addr': '172.21.15.104:6803/40673', 'heartbeat_back_addr': '172.21.15.104:6807/40673', 'heartbeat_front_addr': '172.21.15.104:6805/40673', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.032022+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.017304+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:09:40.048371+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.1d', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:10:27.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:10:27.604 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 15 16 49718 49702 207.068 152.938 0.0123868 0.0048251 2024-04-26T12:10:27.611 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:27.611+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:27.692 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-26T12:10:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-26T12:10:27.693 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:27.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:27.747 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:27.746+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:27.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:27.813 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:27.812+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:27.914 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:27.913+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:27.929 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-26T12:10:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-26T12:10:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33759 5.1 5:84a1f1a6:::benchmark_data_smithi045_43640_object33758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.3087655959999998, 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016968066, 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33759 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616495+0000", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5689999999999998e-05 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616500+0000", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6540000000000004e-06 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616504+0000", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622769+0000", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062649180000000004 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622858+0000", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9061000000000007e-05 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622968+0000", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109968 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.626085+0000", 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031169380000000001 2024-04-26T12:10:27.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633354+0000", 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007269195 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633393+0000", 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-05 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633417+0000", 2024-04-26T12:10:27.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4714000000000001e-05 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33873 5.f 5:f393a60f:::benchmark_data_smithi045_43640_object33872:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.659482+0000", 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.2657327870000001, 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015570044, 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33873 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659482+0000", 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659482+0000", 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659481+0000", 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659532+0000", 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0593999999999997e-05 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659547+0000", 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5322e-05 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659555+0000", 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0879999999999995e-06 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659596+0000", 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0803000000000002e-05 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659736+0000", 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013997400000000001 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659841+0000", 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105432 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663567+0000", 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037254010000000001 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674943+0000", 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011375931000000001 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675002+0000", 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9626999999999997e-05 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675052+0000", 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9801e-05 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33877 5.f 5:f51a14f1:::benchmark_data_smithi045_43640_object33876:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.2653241279999996, 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018870086000000001, 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33877 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:27.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659890+0000", 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660025+0000", 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013460999999999999 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660034+0000", 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5610000000000004e-06 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660042+0000", 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6539999999999999e-06 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662113+0000", 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020712669999999999 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662224+0000", 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111047 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662342+0000", 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117724 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674933+0000", 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012590874 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678698+0000", 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003764744 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678727+0000", 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9731999999999999e-05 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678761+0000", 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3689999999999998e-05 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33879 5.f 5:fe04d5bf:::benchmark_data_smithi045_43640_object33878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.2651632660000001, 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018825173000000001, 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33879 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:27.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660051+0000", 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660142+0000", 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1260000000000004e-05 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660165+0000", 2024-04-26T12:10:27.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2415000000000001e-05 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660173+0000", 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8939999999999993e-06 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664571+0000", 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043981319999999999 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664692+0000", 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120973 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664834+0000", 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014225699999999999 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675098+0000", 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01026411 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678827+0000", 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037293489999999999 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678850+0000", 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2881e-05 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678877+0000", 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33880 5.7 5:ed20740e:::benchmark_data_smithi045_43640_object33879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.265034451, 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018640117000000001, 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33880 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660180+0000", 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660214+0000", 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3918999999999998e-05 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660223+0000", 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4720000000000001e-06 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660229+0000", 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.105e-06 2024-04-26T12:10:27.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663597+0000", 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033676520000000001 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663724+0000", 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012658400000000001 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663845+0000", 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121259 2024-04-26T12:10:27.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674912+0000", 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011067359000000001 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678766+0000", 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038536619999999999 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678792+0000", 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6057000000000001e-05 2024-04-26T12:10:27.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678821+0000", 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8759e-05 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33881 5.7 5:e79e3d8f:::benchmark_data_smithi045_43640_object33880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.2649773829999997, 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02032948, 2024-04-26T12:10:27.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33881 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660237+0000", 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660285+0000", 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7581999999999999e-05 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660295+0000", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0343000000000001e-05 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660302+0000", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8959999999999997e-06 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675086+0000", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014784357 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675240+0000", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015400599999999999 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675391+0000", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015063500000000001 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678883+0000", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003492242 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680504+0000", 2024-04-26T12:10:27.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001621209 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680544+0000", 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9360000000000003e-05 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680567+0000", 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3405999999999999e-05 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33890 5.7 5:eb376974:::benchmark_data_smithi045_43640_object33889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.261372519, 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017030601999999999, 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33890 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663889+0000", 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7574999999999998e-05 2024-04-26T12:10:27.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663900+0000", 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0547000000000001e-05 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663907+0000", 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676758+0000", 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012851234 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676858+0000", 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9437000000000004e-05 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676966+0000", 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678886+0000", 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019195010000000001 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680830+0000", 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001943857 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680854+0000", 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4550999999999999e-05 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680873+0000", 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8879999999999999e-05 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.967 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33895 5.7 5:ed801b04:::benchmark_data_smithi045_43640_object33894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.666330+0000", 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.2588852719999997, 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016523388999999999, 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33895 2024-04-26T12:10:27.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666330+0000", 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666330+0000", 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666329+0000", 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666460+0000", 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013093299999999999 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666469+0000", 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9660000000000002e-06 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666476+0000", 2024-04-26T12:10:27.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.677845+0000", 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01136853 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.677933+0000", 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8588e-05 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678017+0000", 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3982999999999999e-05 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.679222+0000", 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012045479999999999 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.682787+0000", 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035649449999999999 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.682817+0000", 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9694999999999999e-05 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.682853+0000", 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6477000000000003e-05 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:37840 5.1 5:81ea6f93:::benchmark_data_smithi045_43640_object37839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9015060889999997, 2024-04-26T12:10:27.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016557145999999998, 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37840 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023708+0000", 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023816+0000", 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010798600000000001 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023823+0000", 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3329999999999999e-06 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023829+0000", 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5929999999999996e-06 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024790+0000", 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096075000000000002 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024861+0000", 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0808000000000004e-05 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024934+0000", 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3213999999999994e-05 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.027949+0000", 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030152529999999999 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040172+0000", 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012223194 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040211+0000", 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8624999999999997e-05 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040266+0000", 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5133999999999998e-05 2024-04-26T12:10:27.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:48201 5.1 5:8834a6b2:::benchmark_data_smithi045_43640_object48200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.93933880599999997, 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017211021, 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 48201 2024-04-26T12:10:27.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985875+0000", 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985974+0000", 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8887000000000004e-05 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985985+0000", 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0716999999999999e-05 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985992+0000", 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0099999999999998e-06 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986021+0000", 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9193999999999999e-05 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986114+0000", 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2709999999999998e-05 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986198+0000", 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3875999999999995e-05 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.991350+0000", 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005152607 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003021+0000", 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011671340000000001 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003053+0000", 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1149999999999998e-05 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003087+0000", 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4533000000000003e-05 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:48206 5.1 5:80754ec1:::benchmark_data_smithi045_43640_object48205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.984 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:26.987469+0000", 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.93774624600000001, 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015697953000000001, 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 48206 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987469+0000", 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987469+0000", 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987468+0000", 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987545+0000", 2024-04-26T12:10:27.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6637999999999994e-05 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987554+0000", 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9070000000000002e-06 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987562+0000", 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3520000000000001e-06 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987622+0000", 2024-04-26T12:10:27.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0346999999999997e-05 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987708+0000", 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5933000000000005e-05 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.987790+0000", 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2274999999999994e-05 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.991354+0000", 2024-04-26T12:10:27.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003564055 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003121+0000", 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011766423 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003147+0000", 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6582000000000001e-05 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003167+0000", 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9225999999999999e-05 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49248 5.7 5:ef9789a4:::benchmark_data_smithi045_43640_object49247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.416256+0000", 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.50895899300000003, 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015743259999999999, 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.990 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49248 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416256+0000", 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416256+0000", 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416256+0000", 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416315+0000", 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9017000000000001e-05 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416322+0000", 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9990000000000002e-06 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416328+0000", 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1530000000000002e-06 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.422373+0000", 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060455800000000001 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.422511+0000", 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137928 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.422651+0000", 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014023099999999999 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.430151+0000", 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074992349999999999 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.431925+0000", 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00177479 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.431965+0000", 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9922000000000002e-05 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.431999+0000", 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3877000000000001e-05 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49249 5.7 5:ef63e26b:::benchmark_data_smithi045_43640_object49248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:27.995 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.416334+0000", 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.50888126499999997, 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015790063, 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49249 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416334+0000", 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416334+0000", 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416333+0000", 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416411+0000", 2024-04-26T12:10:27.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8212000000000003e-05 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416419+0000", 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6909999999999997e-06 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.416425+0000", 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1550000000000004e-06 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:27.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.425419+0000", 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089942029999999992 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.425531+0000", 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111599 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.425639+0000", 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010762100000000001 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.430157+0000", 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045182850000000004 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.432049+0000", 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001891998 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.432091+0000", 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2295000000000001e-05 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.432124+0000", 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2598000000000002e-05 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49307 5.2 5:4de5d634:::benchmark_data_smithi045_43640_object49306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.443284+0000", 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.48193111500000002, 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016550118999999999, 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49307 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443284+0000", 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443284+0000", 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443283+0000", 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443367+0000", 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3521000000000002e-05 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443380+0000", 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3297e-05 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443387+0000", 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3919999999999997e-06 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443965+0000", 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057776099999999999 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.444084+0000", 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118844 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.444215+0000", 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131521 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.452879+0000", 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086637299999999997 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459768+0000", 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068892240000000002 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459800+0000", 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1537e-05 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459834+0000", 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4093e-05 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.006 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49308 5.2 5:4231c474:::benchmark_data_smithi045_43640_object49307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.443911+0000", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.48130410699999998, 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016059639000000001, 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49308 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443911+0000", 2024-04-26T12:10:28.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443911+0000", 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443910+0000", 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443948+0000", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8578999999999998e-05 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443958+0000", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7510000000000003e-06 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443966+0000", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9589999999999995e-06 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.445874+0000", 2024-04-26T12:10:28.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019079380000000001 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.446017+0000", 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142996 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.446167+0000", 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014987999999999999 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.452884+0000", 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067173789999999999 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459883+0000", 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006998392 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459932+0000", 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9347e-05 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459970+0000", 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50361 5.7 5:e5f8ec2d:::benchmark_data_smithi045_43640_object50360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.846194+0000", 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.079021436, 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016520201000000002, 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50361 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846194+0000", 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846194+0000", 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846193+0000", 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846253+0000", 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9567000000000001e-05 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846259+0000", 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846264+0000", 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.011e-06 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.851058+0000", 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047939310000000004 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.851153+0000", 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4376000000000006e-05 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.851258+0000", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105715 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.858299+0000", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070404650000000001 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862635+0000", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043359820000000004 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862677+0000", 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2382000000000002e-05 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862714+0000", 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6547000000000001e-05 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50366 5.7 5:ee434614:::benchmark_data_smithi045_43640_object50365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:28.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.076199591999999997, 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016095155999999999, 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50366 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849072+0000", 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7108000000000003e-05 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849082+0000", 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0550000000000001e-05 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849090+0000", 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8900000000000007e-06 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.852599+0000", 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003508621 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.852721+0000", 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012251100000000001 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.852847+0000", 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012527999999999999 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.858369+0000", 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055228250000000003 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865042+0000", 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066726019999999997 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865073+0000", 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1047000000000003e-05 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865111+0000", 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7412e-05 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50388 5.f 5:f0788b7d:::benchmark_data_smithi045_43640_object50387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.857338+0000", 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.067876939999999997, 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015718975999999999, 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50388 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.857338+0000", 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.857338+0000", 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.857337+0000", 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:28.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.857449+0000", 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111265 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.857463+0000", 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3940999999999999e-05 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.857470+0000", 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0650000000000001e-06 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.860912+0000", 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034422699999999999 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.861032+0000", 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119695 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.861125+0000", 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3404000000000002e-05 2024-04-26T12:10:28.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865035+0000", 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039098919999999999 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.872974+0000", 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079393080000000008 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.873021+0000", 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6900000000000002e-05 2024-04-26T12:10:28.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.873057+0000", 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5902999999999998e-05 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50399 5.7 5:ec508f68:::benchmark_data_smithi045_43640_object50398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.062583151000000004, 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019023064999999999, 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50399 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:28.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862631+0000", 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862738+0000", 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106563 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862758+0000", 2024-04-26T12:10:28.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0044999999999999e-05 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862773+0000", 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.868879+0000", 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061068269999999996 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.869013+0000", 2024-04-26T12:10:28.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013344400000000001 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.869145+0000", 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013240300000000001 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.876895+0000", 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077496470000000001 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881560+0000", 2024-04-26T12:10:28.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046651339999999996 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881613+0000", 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3415999999999998e-05 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881655+0000", 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1389e-05 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50402 5.7 5:e2d53af1:::benchmark_data_smithi045_43640_object50401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.060560876999999999, 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017115340999999999, 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50402 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:28.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864653+0000", 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:28.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864724+0000", 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0258000000000004e-05 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864732+0000", 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6270000000000006e-06 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864738+0000", 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7420000000000003e-06 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:28.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.870921+0000", 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006182786 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.871111+0000", 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019038200000000001 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.871288+0000", 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017691699999999999 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:28.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.876980+0000", 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005691537 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881703+0000", 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047232660000000003 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881744+0000", 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1010999999999997e-05 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:28.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881769+0000", 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5531999999999999e-05 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:28.039 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:28.040 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:10:28.041 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:28.038+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:28.041 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:28.042 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:28.043 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:28.046 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:10:28.048 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:10:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:28.050 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-26T12:10:27.942035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3142912858,"num_objects":47972,"num_object_clones":0,"num_object_copies":95944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47972,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":48196,"num_write_kb":3072146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48144,"ondisk_log_size":48144,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":6036764,"kb_used_data":5858880,"kb_used_omap":4,"kb_used_meta":177787,"kb_avail":277078756,"statfs":{"total":289910292480,"available":283728646144,"internally_reserved":0,"allocated":5999493120,"data_stored":5998973344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":182054226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1910308864,"num_objects":29149,"num_object_clones":0,"num_object_copies":58298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29149,"num_write_kb":1865536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.077949"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922381+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:10:21.922381+0000","last_peered":"2024-04-26T12:10:21.922381+0000","last_clean":"2024-04-26T12:10:21.922381+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:10:21.922381+0000","last_undegraded":"2024-04-26T12:10:21.922381+0000","last_fullsized":"2024-04-26T12:10:21.922381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922151+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:10:21.922151+0000","last_peered":"2024-04-26T12:10:21.922151+0000","last_clean":"2024-04-26T12:10:21.922151+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:10:21.922151+0000","last_undegraded":"2024-04-26T12:10:21.922151+0000","last_fullsized":"2024-04-26T12:10:21.922151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926271+0000","last_change":"2024-04-26T12:09:49.377523+0000","last_active":"2024-04-26T12:10:21.926271+0000","last_peered":"2024-04-26T12:10:21.926271+0000","last_clean":"2024-04-26T12:10:21.926271+0000","last_became_active":"2024-04-26T12:09:49.374018+0000","last_became_peered":"2024-04-26T12:09:49.374018+0000","last_unstale":"2024-04-26T12:10:21.926271+0000","last_undegraded":"2024-04-26T12:10:21.926271+0000","last_fullsized":"2024-04-26T12:10:21.926271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:53.646134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924561+0000","last_change":"2024-04-26T12:09:49.378014+0000","last_active":"2024-04-26T12:10:21.924561+0000","last_peered":"2024-04-26T12:10:21.924561+0000","last_clean":"2024-04-26T12:10:21.924561+0000","last_became_active":"2024-04-26T12:09:49.377499+0000","last_became_peered":"2024-04-26T12:09:49.377499+0000","last_unstale":"2024-04-26T12:10:21.924561+0000","last_undegraded":"2024-04-26T12:10:21.924561+0000","last_fullsized":"2024-04-26T12:10:21.924561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.712978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921719+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:10:21.921719+0000","last_peered":"2024-04-26T12:10:21.921719+0000","last_clean":"2024-04-26T12:10:21.921719+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:10:21.921719+0000","last_undegraded":"2024-04-26T12:10:21.921719+0000","last_fullsized":"2024-04-26T12:10:21.921719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926737+0000","last_change":"2024-04-26T12:09:49.373396+0000","last_active":"2024-04-26T12:10:21.926737+0000","last_peered":"2024-04-26T12:10:21.926737+0000","last_clean":"2024-04-26T12:10:21.926737+0000","last_became_active":"2024-04-26T12:09:49.372819+0000","last_became_peered":"2024-04-26T12:09:49.372819+0000","last_unstale":"2024-04-26T12:10:21.926737+0000","last_undegraded":"2024-04-26T12:10:21.926737+0000","last_fullsized":"2024-04-26T12:10:21.926737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927840+0000","last_change":"2024-04-26T12:09:49.373051+0000","last_active":"2024-04-26T12:10:21.927840+0000","last_peered":"2024-04-26T12:10:21.927840+0000","last_clean":"2024-04-26T12:10:21.927840+0000","last_became_active":"2024-04-26T12:09:49.371351+0000","last_became_peered":"2024-04-26T12:09:49.371351+0000","last_unstale":"2024-04-26T12:10:21.927840+0000","last_undegraded":"2024-04-26T12:10:21.927840+0000","last_fullsized":"2024-04-26T12:10:21.927840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924145+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:10:21.924145+0000","last_peered":"2024-04-26T12:10:21.924145+0000","last_clean":"2024-04-26T12:10:21.924145+0000","last_became_active":"2024-04-26T12:09:49.379362+0000","last_became_peered":"2024-04-26T12:09:49.379362+0000","last_unstale":"2024-04-26T12:10:21.924145+0000","last_undegraded":"2024-04-26T12:10:21.924145+0000","last_fullsized":"2024-04-26T12:10:21.924145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927209+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:10:21.927209+0000","last_peered":"2024-04-26T12:10:21.927209+0000","last_clean":"2024-04-26T12:10:21.927209+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:10:21.927209+0000","last_undegraded":"2024-04-26T12:10:21.927209+0000","last_fullsized":"2024-04-26T12:10:21.927209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922379+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:10:21.922379+0000","last_peered":"2024-04-26T12:10:21.922379+0000","last_clean":"2024-04-26T12:10:21.922379+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:10:21.922379+0000","last_undegraded":"2024-04-26T12:10:21.922379+0000","last_fullsized":"2024-04-26T12:10:21.922379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926384+0000","last_change":"2024-04-26T12:09:49.370683+0000","last_active":"2024-04-26T12:10:21.926384+0000","last_peered":"2024-04-26T12:10:21.926384+0000","last_clean":"2024-04-26T12:10:21.926384+0000","last_became_active":"2024-04-26T12:09:49.369903+0000","last_became_peered":"2024-04-26T12:09:49.369903+0000","last_unstale":"2024-04-26T12:10:21.926384+0000","last_undegraded":"2024-04-26T12:10:21.926384+0000","last_fullsized":"2024-04-26T12:10:21.926384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921869+0000","last_change":"2024-04-26T12:09:49.378187+0000","last_active":"2024-04-26T12:10:21.921869+0000","last_peered":"2024-04-26T12:10:21.921869+0000","last_clean":"2024-04-26T12:10:21.921869+0000","last_became_active":"2024-04-26T12:09:49.377668+0000","last_became_peered":"2024-04-26T12:09:49.377668+0000","last_unstale":"2024-04-26T12:10:21.921869+0000","last_undegraded":"2024-04-26T12:10:21.921869+0000","last_fullsized":"2024-04-26T12:10:21.921869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:59.207440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921949+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:10:21.921949+0000","last_peered":"2024-04-26T12:10:21.921949+0000","last_clean":"2024-04-26T12:10:21.921949+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:10:21.921949+0000","last_undegraded":"2024-04-26T12:10:21.921949+0000","last_fullsized":"2024-04-26T12:10:21.921949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926667+0000","last_change":"2024-04-26T12:09:49.375183+0000","last_active":"2024-04-26T12:10:21.926667+0000","last_peered":"2024-04-26T12:10:21.926667+0000","last_clean":"2024-04-26T12:10:21.926667+0000","last_became_active":"2024-04-26T12:09:49.373997+0000","last_became_peered":"2024-04-26T12:09:49.373997+0000","last_unstale":"2024-04-26T12:10:21.926667+0000","last_undegraded":"2024-04-26T12:10:21.926667+0000","last_fullsized":"2024-04-26T12:10:21.926667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927758+0000","last_change":"2024-04-26T12:09:49.376578+0000","last_active":"2024-04-26T12:10:21.927758+0000","last_peered":"2024-04-26T12:10:21.927758+0000","last_clean":"2024-04-26T12:10:21.927758+0000","last_became_active":"2024-04-26T12:09:49.375379+0000","last_became_peered":"2024-04-26T12:09:49.375379+0000","last_unstale":"2024-04-26T12:10:21.927758+0000","last_undegraded":"2024-04-26T12:10:21.927758+0000","last_fullsized":"2024-04-26T12:10:21.927758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924494+0000","last_change":"2024-04-26T12:09:49.379297+0000","last_active":"2024-04-26T12:10:21.924494+0000","last_peered":"2024-04-26T12:10:21.924494+0000","last_clean":"2024-04-26T12:10:21.924494+0000","last_became_active":"2024-04-26T12:09:49.378709+0000","last_became_peered":"2024-04-26T12:09:49.378709+0000","last_unstale":"2024-04-26T12:10:21.924494+0000","last_undegraded":"2024-04-26T12:10:21.924494+0000","last_fullsized":"2024-04-26T12:10:21.924494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927289+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:10:21.927289+0000","last_peered":"2024-04-26T12:10:21.927289+0000","last_clean":"2024-04-26T12:10:21.927289+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:10:21.927289+0000","last_undegraded":"2024-04-26T12:10:21.927289+0000","last_fullsized":"2024-04-26T12:10:21.927289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922301+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:10:21.922301+0000","last_peered":"2024-04-26T12:10:21.922301+0000","last_clean":"2024-04-26T12:10:21.922301+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:10:21.922301+0000","last_undegraded":"2024-04-26T12:10:21.922301+0000","last_fullsized":"2024-04-26T12:10:21.922301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927795+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:10:21.927795+0000","last_peered":"2024-04-26T12:10:21.927795+0000","last_clean":"2024-04-26T12:10:21.927795+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:10:21.927795+0000","last_undegraded":"2024-04-26T12:10:21.927795+0000","last_fullsized":"2024-04-26T12:10:21.927795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924673+0000","last_change":"2024-04-26T12:09:49.373600+0000","last_active":"2024-04-26T12:10:21.924673+0000","last_peered":"2024-04-26T12:10:21.924673+0000","last_clean":"2024-04-26T12:10:21.924673+0000","last_became_active":"2024-04-26T12:09:49.371246+0000","last_became_peered":"2024-04-26T12:09:49.371246+0000","last_unstale":"2024-04-26T12:10:21.924673+0000","last_undegraded":"2024-04-26T12:10:21.924673+0000","last_fullsized":"2024-04-26T12:10:21.924673+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924344+0000","last_change":"2024-04-26T12:09:49.375382+0000","last_active":"2024-04-26T12:10:21.924344+0000","last_peered":"2024-04-26T12:10:21.924344+0000","last_clean":"2024-04-26T12:10:21.924344+0000","last_became_active":"2024-04-26T12:09:49.373068+0000","last_became_peered":"2024-04-26T12:09:49.373068+0000","last_unstale":"2024-04-26T12:10:21.924344+0000","last_undegraded":"2024-04-26T12:10:21.924344+0000","last_fullsized":"2024-04-26T12:10:21.924344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921497+0000","last_change":"2024-04-26T12:09:49.378018+0000","last_active":"2024-04-26T12:10:21.921497+0000","last_peered":"2024-04-26T12:10:21.921497+0000","last_clean":"2024-04-26T12:10:21.921497+0000","last_became_active":"2024-04-26T12:09:49.377413+0000","last_became_peered":"2024-04-26T12:09:49.377413+0000","last_unstale":"2024-04-26T12:10:21.921497+0000","last_undegraded":"2024-04-26T12:10:21.921497+0000","last_fullsized":"2024-04-26T12:10:21.921497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:24.485208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927129+0000","last_change":"2024-04-26T12:09:49.379732+0000","last_active":"2024-04-26T12:10:21.927129+0000","last_peered":"2024-04-26T12:10:21.927129+0000","last_clean":"2024-04-26T12:10:21.927129+0000","last_became_active":"2024-04-26T12:09:49.379418+0000","last_became_peered":"2024-04-26T12:09:49.379418+0000","last_unstale":"2024-04-26T12:10:21.927129+0000","last_undegraded":"2024-04-26T12:10:21.927129+0000","last_fullsized":"2024-04-26T12:10:21.927129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921871+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:10:21.921871+0000","last_peered":"2024-04-26T12:10:21.921871+0000","last_clean":"2024-04-26T12:10:21.921871+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:10:21.921871+0000","last_undegraded":"2024-04-26T12:10:21.921871+0000","last_fullsized":"2024-04-26T12:10:21.921871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922311+0000","last_change":"2024-04-26T12:09:49.370653+0000","last_active":"2024-04-26T12:10:21.922311+0000","last_peered":"2024-04-26T12:10:21.922311+0000","last_clean":"2024-04-26T12:10:21.922311+0000","last_became_active":"2024-04-26T12:09:49.369712+0000","last_became_peered":"2024-04-26T12:09:49.369712+0000","last_unstale":"2024-04-26T12:10:21.922311+0000","last_undegraded":"2024-04-26T12:10:21.922311+0000","last_fullsized":"2024-04-26T12:10:21.922311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:25.644155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927328+0000","last_change":"2024-04-26T12:09:49.379381+0000","last_active":"2024-04-26T12:10:21.927328+0000","last_peered":"2024-04-26T12:10:21.927328+0000","last_clean":"2024-04-26T12:10:21.927328+0000","last_became_active":"2024-04-26T12:09:49.378705+0000","last_became_peered":"2024-04-26T12:09:49.378705+0000","last_unstale":"2024-04-26T12:10:21.927328+0000","last_undegraded":"2024-04-26T12:10:21.927328+0000","last_fullsized":"2024-04-26T12:10:21.927328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926488+0000","last_change":"2024-04-26T12:09:49.378504+0000","last_active":"2024-04-26T12:10:21.926488+0000","last_peered":"2024-04-26T12:10:21.926488+0000","last_clean":"2024-04-26T12:10:21.926488+0000","last_became_active":"2024-04-26T12:09:49.376218+0000","last_became_peered":"2024-04-26T12:09:49.376218+0000","last_unstale":"2024-04-26T12:10:21.926488+0000","last_undegraded":"2024-04-26T12:10:21.926488+0000","last_fullsized":"2024-04-26T12:10:21.926488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921498+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:10:21.921498+0000","last_peered":"2024-04-26T12:10:21.921498+0000","last_clean":"2024-04-26T12:10:21.921498+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:10:21.921498+0000","last_undegraded":"2024-04-26T12:10:21.921498+0000","last_fullsized":"2024-04-26T12:10:21.921498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922163+0000","last_change":"2024-04-26T12:09:49.377892+0000","last_active":"2024-04-26T12:10:21.922163+0000","last_peered":"2024-04-26T12:10:21.922163+0000","last_clean":"2024-04-26T12:10:21.922163+0000","last_became_active":"2024-04-26T12:09:49.377393+0000","last_became_peered":"2024-04-26T12:09:49.377393+0000","last_unstale":"2024-04-26T12:10:21.922163+0000","last_undegraded":"2024-04-26T12:10:21.922163+0000","last_fullsized":"2024-04-26T12:10:21.922163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:51.058952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926934+0000","last_change":"2024-04-26T12:09:48.934676+0000","last_active":"2024-04-26T12:10:21.926934+0000","last_peered":"2024-04-26T12:10:21.926934+0000","last_clean":"2024-04-26T12:10:21.926934+0000","last_became_active":"2024-04-26T12:09:48.934323+0000","last_became_peered":"2024-04-26T12:09:48.934323+0000","last_unstale":"2024-04-26T12:10:21.926934+0000","last_undegraded":"2024-04-26T12:10:21.926934+0000","last_fullsized":"2024-04-26T12:10:21.926934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927414+0000","last_change":"2024-04-26T12:09:49.382282+0000","last_active":"2024-04-26T12:10:21.927414+0000","last_peered":"2024-04-26T12:10:21.927414+0000","last_clean":"2024-04-26T12:10:21.927414+0000","last_became_active":"2024-04-26T12:09:49.381426+0000","last_became_peered":"2024-04-26T12:09:49.381426+0000","last_unstale":"2024-04-26T12:10:21.927414+0000","last_undegraded":"2024-04-26T12:10:21.927414+0000","last_fullsized":"2024-04-26T12:10:21.927414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.928295+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:10:21.928295+0000","last_peered":"2024-04-26T12:10:21.928295+0000","last_clean":"2024-04-26T12:10:21.928295+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:10:21.928295+0000","last_undegraded":"2024-04-26T12:10:21.928295+0000","last_fullsized":"2024-04-26T12:10:21.928295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922301+0000","last_change":"2024-04-26T12:09:49.377327+0000","last_active":"2024-04-26T12:10:21.922301+0000","last_peered":"2024-04-26T12:10:21.922301+0000","last_clean":"2024-04-26T12:10:21.922301+0000","last_became_active":"2024-04-26T12:09:49.376929+0000","last_became_peered":"2024-04-26T12:09:49.376929+0000","last_unstale":"2024-04-26T12:10:21.922301+0000","last_undegraded":"2024-04-26T12:10:21.922301+0000","last_fullsized":"2024-04-26T12:10:21.922301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927822+0000","last_change":"2024-04-26T12:09:48.934683+0000","last_active":"2024-04-26T12:10:21.927822+0000","last_peered":"2024-04-26T12:10:21.927822+0000","last_clean":"2024-04-26T12:10:21.927822+0000","last_became_active":"2024-04-26T12:09:48.934474+0000","last_became_peered":"2024-04-26T12:09:48.934474+0000","last_unstale":"2024-04-26T12:10:21.927822+0000","last_undegraded":"2024-04-26T12:10:21.927822+0000","last_fullsized":"2024-04-26T12:10:21.927822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.928213+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:10:21.928213+0000","last_peered":"2024-04-26T12:10:21.928213+0000","last_clean":"2024-04-26T12:10:21.928213+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:10:21.928213+0000","last_undegraded":"2024-04-26T12:10:21.928213+0000","last_fullsized":"2024-04-26T12:10:21.928213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926299+0000","last_change":"2024-04-26T12:09:48.932217+0000","last_active":"2024-04-26T12:10:21.926299+0000","last_peered":"2024-04-26T12:10:21.926299+0000","last_clean":"2024-04-26T12:10:21.926299+0000","last_became_active":"2024-04-26T12:09:48.931772+0000","last_became_peered":"2024-04-26T12:09:48.931772+0000","last_unstale":"2024-04-26T12:10:21.926299+0000","last_undegraded":"2024-04-26T12:10:21.926299+0000","last_fullsized":"2024-04-26T12:10:21.926299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:12.097647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926903+0000","last_change":"2024-04-26T12:09:49.379849+0000","last_active":"2024-04-26T12:10:21.926903+0000","last_peered":"2024-04-26T12:10:21.926903+0000","last_clean":"2024-04-26T12:10:21.926903+0000","last_became_active":"2024-04-26T12:09:49.379489+0000","last_became_peered":"2024-04-26T12:09:49.379489+0000","last_unstale":"2024-04-26T12:10:21.926903+0000","last_undegraded":"2024-04-26T12:10:21.926903+0000","last_fullsized":"2024-04-26T12:10:21.926903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921894+0000","last_change":"2024-04-26T12:09:48.930301+0000","last_active":"2024-04-26T12:10:21.921894+0000","last_peered":"2024-04-26T12:10:21.921894+0000","last_clean":"2024-04-26T12:10:21.921894+0000","last_became_active":"2024-04-26T12:09:48.929668+0000","last_became_peered":"2024-04-26T12:09:48.929668+0000","last_unstale":"2024-04-26T12:10:21.921894+0000","last_undegraded":"2024-04-26T12:10:21.921894+0000","last_fullsized":"2024-04-26T12:10:21.921894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.928273+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:10:21.928273+0000","last_peered":"2024-04-26T12:10:21.928273+0000","last_clean":"2024-04-26T12:10:21.928273+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:10:21.928273+0000","last_undegraded":"2024-04-26T12:10:21.928273+0000","last_fullsized":"2024-04-26T12:10:21.928273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924731+0000","last_change":"2024-04-26T12:09:48.931166+0000","last_active":"2024-04-26T12:10:21.924731+0000","last_peered":"2024-04-26T12:10:21.924731+0000","last_clean":"2024-04-26T12:10:21.924731+0000","last_became_active":"2024-04-26T12:09:48.928510+0000","last_became_peered":"2024-04-26T12:09:48.928510+0000","last_unstale":"2024-04-26T12:10:21.924731+0000","last_undegraded":"2024-04-26T12:10:21.924731+0000","last_fullsized":"2024-04-26T12:10:21.924731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:34.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924494+0000","last_change":"2024-04-26T12:09:49.376111+0000","last_active":"2024-04-26T12:10:21.924494+0000","last_peered":"2024-04-26T12:10:21.924494+0000","last_clean":"2024-04-26T12:10:21.924494+0000","last_became_active":"2024-04-26T12:09:49.375354+0000","last_became_peered":"2024-04-26T12:09:49.375354+0000","last_unstale":"2024-04-26T12:10:21.924494+0000","last_undegraded":"2024-04-26T12:10:21.924494+0000","last_fullsized":"2024-04-26T12:10:21.924494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924411+0000","last_change":"2024-04-26T12:09:48.932524+0000","last_active":"2024-04-26T12:10:21.924411+0000","last_peered":"2024-04-26T12:10:21.924411+0000","last_clean":"2024-04-26T12:10:21.924411+0000","last_became_active":"2024-04-26T12:09:48.931946+0000","last_became_peered":"2024-04-26T12:09:48.931946+0000","last_unstale":"2024-04-26T12:10:21.924411+0000","last_undegraded":"2024-04-26T12:10:21.924411+0000","last_fullsized":"2024-04-26T12:10:21.924411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.506715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921942+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:10:21.921942+0000","last_peered":"2024-04-26T12:10:21.921942+0000","last_clean":"2024-04-26T12:10:21.921942+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:10:21.921942+0000","last_undegraded":"2024-04-26T12:10:21.921942+0000","last_fullsized":"2024-04-26T12:10:21.921942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927645+0000","last_change":"2024-04-26T12:09:48.933842+0000","last_active":"2024-04-26T12:10:21.927645+0000","last_peered":"2024-04-26T12:10:21.927645+0000","last_clean":"2024-04-26T12:10:21.927645+0000","last_became_active":"2024-04-26T12:09:48.933285+0000","last_became_peered":"2024-04-26T12:09:48.933285+0000","last_unstale":"2024-04-26T12:10:21.927645+0000","last_undegraded":"2024-04-26T12:10:21.927645+0000","last_fullsized":"2024-04-26T12:10:21.927645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922251+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:10:21.922251+0000","last_peered":"2024-04-26T12:10:21.922251+0000","last_clean":"2024-04-26T12:10:21.922251+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:10:21.922251+0000","last_undegraded":"2024-04-26T12:10:21.922251+0000","last_fullsized":"2024-04-26T12:10:21.922251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921444+0000","last_change":"2024-04-26T12:09:48.930202+0000","last_active":"2024-04-26T12:10:21.921444+0000","last_peered":"2024-04-26T12:10:21.921444+0000","last_clean":"2024-04-26T12:10:21.921444+0000","last_became_active":"2024-04-26T12:09:48.929872+0000","last_became_peered":"2024-04-26T12:09:48.929872+0000","last_unstale":"2024-04-26T12:10:21.921444+0000","last_undegraded":"2024-04-26T12:10:21.921444+0000","last_fullsized":"2024-04-26T12:10:21.921444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927580+0000","last_change":"2024-04-26T12:09:49.382005+0000","last_active":"2024-04-26T12:10:21.927580+0000","last_peered":"2024-04-26T12:10:21.927580+0000","last_clean":"2024-04-26T12:10:21.927580+0000","last_became_active":"2024-04-26T12:09:49.381350+0000","last_became_peered":"2024-04-26T12:09:49.381350+0000","last_unstale":"2024-04-26T12:10:21.927580+0000","last_undegraded":"2024-04-26T12:10:21.927580+0000","last_fullsized":"2024-04-26T12:10:21.927580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:49.789846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924497+0000","last_change":"2024-04-26T12:09:48.927686+0000","last_active":"2024-04-26T12:10:21.924497+0000","last_peered":"2024-04-26T12:10:21.924497+0000","last_clean":"2024-04-26T12:10:21.924497+0000","last_became_active":"2024-04-26T12:09:48.927327+0000","last_became_peered":"2024-04-26T12:09:48.927327+0000","last_unstale":"2024-04-26T12:10:21.924497+0000","last_undegraded":"2024-04-26T12:10:21.924497+0000","last_fullsized":"2024-04-26T12:10:21.924497+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.928325+0000","last_change":"2024-04-26T12:09:49.382784+0000","last_active":"2024-04-26T12:10:21.928325+0000","last_peered":"2024-04-26T12:10:21.928325+0000","last_clean":"2024-04-26T12:10:21.928325+0000","last_became_active":"2024-04-26T12:09:49.382492+0000","last_became_peered":"2024-04-26T12:09:49.382492+0000","last_unstale":"2024-04-26T12:10:21.928325+0000","last_undegraded":"2024-04-26T12:10:21.928325+0000","last_fullsized":"2024-04-26T12:10:21.928325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"24'2959","reported_seq":2974,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.871258+0000","last_change":"2024-04-26T12:10:11.430991+0000","last_active":"2024-04-26T12:10:26.871258+0000","last_peered":"2024-04-26T12:10:26.871258+0000","last_clean":"2024-04-26T12:10:26.871258+0000","last_became_active":"2024-04-26T12:10:11.430700+0000","last_became_peered":"2024-04-26T12:10:11.430700+0000","last_unstale":"2024-04-26T12:10:26.871258+0000","last_undegraded":"2024-04-26T12:10:26.871258+0000","last_fullsized":"2024-04-26T12:10:26.871258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":0,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:20.995419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193921024,"num_objects":2959,"num_object_clones":0,"num_object_copies":5918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2959,"num_write_kb":189376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924964+0000","last_change":"2024-04-26T12:09:48.929684+0000","last_active":"2024-04-26T12:10:21.924964+0000","last_peered":"2024-04-26T12:10:21.924964+0000","last_clean":"2024-04-26T12:10:21.924964+0000","last_became_active":"2024-04-26T12:09:48.929286+0000","last_became_peered":"2024-04-26T12:09:48.929286+0000","last_unstale":"2024-04-26T12:10:21.924964+0000","last_undegraded":"2024-04-26T12:10:21.924964+0000","last_fullsized":"2024-04-26T12:10:21.924964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921324+0000","last_change":"2024-04-26T12:09:49.369646+0000","last_active":"2024-04-26T12:10:21.921324+0000","last_peered":"2024-04-26T12:10:21.921324+0000","last_clean":"2024-04-26T12:10:21.921324+0000","last_became_active":"2024-04-26T12:09:49.369239+0000","last_became_peered":"2024-04-26T12:09:49.369239+0000","last_unstale":"2024-04-26T12:10:21.921324+0000","last_undegraded":"2024-04-26T12:10:21.921324+0000","last_fullsized":"2024-04-26T12:10:21.921324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:11.544712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"24'2906","reported_seq":2921,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.866394+0000","last_change":"2024-04-26T12:10:11.429665+0000","last_active":"2024-04-26T12:10:26.866394+0000","last_peered":"2024-04-26T12:10:26.866394+0000","last_clean":"2024-04-26T12:10:26.866394+0000","last_became_active":"2024-04-26T12:10:11.429318+0000","last_became_peered":"2024-04-26T12:10:11.429318+0000","last_unstale":"2024-04-26T12:10:26.866394+0000","last_undegraded":"2024-04-26T12:10:26.866394+0000","last_fullsized":"2024-04-26T12:10:26.866394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:20.995419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190447616,"num_objects":2906,"num_object_clones":0,"num_object_copies":5812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2906,"num_write_kb":185984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922027+0000","last_change":"2024-04-26T12:09:48.933750+0000","last_active":"2024-04-26T12:10:21.922027+0000","last_peered":"2024-04-26T12:10:21.922027+0000","last_clean":"2024-04-26T12:10:21.922027+0000","last_became_active":"2024-04-26T12:09:48.933518+0000","last_became_peered":"2024-04-26T12:09:48.933518+0000","last_unstale":"2024-04-26T12:10:21.922027+0000","last_undegraded":"2024-04-26T12:10:21.922027+0000","last_fullsized":"2024-04-26T12:10:21.922027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:45.840821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921586+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:10:21.921586+0000","last_peered":"2024-04-26T12:10:21.921586+0000","last_clean":"2024-04-26T12:10:21.921586+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:10:21.921586+0000","last_undegraded":"2024-04-26T12:10:21.921586+0000","last_fullsized":"2024-04-26T12:10:21.921586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"24'2932","reported_seq":2947,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.871315+0000","last_change":"2024-04-26T12:10:11.429568+0000","last_active":"2024-04-26T12:10:26.871315+0000","last_peered":"2024-04-26T12:10:26.871315+0000","last_clean":"2024-04-26T12:10:26.871315+0000","last_became_active":"2024-04-26T12:10:11.429206+0000","last_became_peered":"2024-04-26T12:10:11.429206+0000","last_unstale":"2024-04-26T12:10:26.871315+0000","last_undegraded":"2024-04-26T12:10:26.871315+0000","last_fullsized":"2024-04-26T12:10:26.871315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:15.449895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192151552,"num_objects":2932,"num_object_clones":0,"num_object_copies":5864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2932,"num_write_kb":187648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926323+0000","last_change":"2024-04-26T12:09:48.930396+0000","last_active":"2024-04-26T12:10:21.926323+0000","last_peered":"2024-04-26T12:10:21.926323+0000","last_clean":"2024-04-26T12:10:21.926323+0000","last_became_active":"2024-04-26T12:09:48.928635+0000","last_became_peered":"2024-04-26T12:09:48.928635+0000","last_unstale":"2024-04-26T12:10:21.926323+0000","last_undegraded":"2024-04-26T12:10:21.926323+0000","last_fullsized":"2024-04-26T12:10:21.926323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:19:08.697066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926601+0000","last_change":"2024-04-26T12:09:49.371307+0000","last_active":"2024-04-26T12:10:21.926601+0000","last_peered":"2024-04-26T12:10:21.926601+0000","last_clean":"2024-04-26T12:10:21.926601+0000","last_became_active":"2024-04-26T12:09:49.369951+0000","last_became_peered":"2024-04-26T12:09:49.369951+0000","last_unstale":"2024-04-26T12:10:21.926601+0000","last_undegraded":"2024-04-26T12:10:21.926601+0000","last_fullsized":"2024-04-26T12:10:21.926601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"24'2976","reported_seq":2991,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.872738+0000","last_change":"2024-04-26T12:10:11.427962+0000","last_active":"2024-04-26T12:10:26.872738+0000","last_peered":"2024-04-26T12:10:26.872738+0000","last_clean":"2024-04-26T12:10:26.872738+0000","last_became_active":"2024-04-26T12:10:11.427433+0000","last_became_peered":"2024-04-26T12:10:11.427433+0000","last_unstale":"2024-04-26T12:10:26.872738+0000","last_undegraded":"2024-04-26T12:10:26.872738+0000","last_fullsized":"2024-04-26T12:10:26.872738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:34.132883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195035136,"num_objects":2976,"num_object_clones":0,"num_object_copies":5952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2976,"num_write_kb":190464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924412+0000","last_change":"2024-04-26T12:09:48.931139+0000","last_active":"2024-04-26T12:10:21.924412+0000","last_peered":"2024-04-26T12:10:21.924412+0000","last_clean":"2024-04-26T12:10:21.924412+0000","last_became_active":"2024-04-26T12:09:48.929513+0000","last_became_peered":"2024-04-26T12:09:48.929513+0000","last_unstale":"2024-04-26T12:10:21.924412+0000","last_undegraded":"2024-04-26T12:10:21.924412+0000","last_fullsized":"2024-04-26T12:10:21.924412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:04.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927300+0000","last_change":"2024-04-26T12:09:49.379548+0000","last_active":"2024-04-26T12:10:21.927300+0000","last_peered":"2024-04-26T12:10:21.927300+0000","last_clean":"2024-04-26T12:10:21.927300+0000","last_became_active":"2024-04-26T12:09:49.378999+0000","last_became_peered":"2024-04-26T12:09:49.378999+0000","last_unstale":"2024-04-26T12:10:21.927300+0000","last_undegraded":"2024-04-26T12:10:21.927300+0000","last_fullsized":"2024-04-26T12:10:21.927300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:09.763836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"24'2930","reported_seq":2944,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.886024+0000","last_change":"2024-04-26T12:10:11.434420+0000","last_active":"2024-04-26T12:10:26.886024+0000","last_peered":"2024-04-26T12:10:26.886024+0000","last_clean":"2024-04-26T12:10:26.886024+0000","last_became_active":"2024-04-26T12:10:11.434160+0000","last_became_peered":"2024-04-26T12:10:11.434160+0000","last_unstale":"2024-04-26T12:10:26.886024+0000","last_undegraded":"2024-04-26T12:10:26.886024+0000","last_fullsized":"2024-04-26T12:10:26.886024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2930,"log_dups_size":0,"ondisk_log_size":2930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:40.106309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192020480,"num_objects":2930,"num_object_clones":0,"num_object_copies":5860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2930,"num_write_kb":187520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927223+0000","last_change":"2024-04-26T12:09:48.933975+0000","last_active":"2024-04-26T12:10:21.927223+0000","last_peered":"2024-04-26T12:10:21.927223+0000","last_clean":"2024-04-26T12:10:21.927223+0000","last_became_active":"2024-04-26T12:09:48.933457+0000","last_became_peered":"2024-04-26T12:09:48.933457+0000","last_unstale":"2024-04-26T12:10:21.927223+0000","last_undegraded":"2024-04-26T12:10:21.927223+0000","last_fullsized":"2024-04-26T12:10:21.927223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:21.660843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924492+0000","last_change":"2024-04-26T12:09:49.373094+0000","last_active":"2024-04-26T12:10:21.924492+0000","last_peered":"2024-04-26T12:10:21.924492+0000","last_clean":"2024-04-26T12:10:21.924492+0000","last_became_active":"2024-04-26T12:09:49.370134+0000","last_became_peered":"2024-04-26T12:09:49.370134+0000","last_unstale":"2024-04-26T12:10:21.924492+0000","last_undegraded":"2024-04-26T12:10:21.924492+0000","last_fullsized":"2024-04-26T12:10:21.924492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"24'3039","reported_seq":3053,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.885643+0000","last_change":"2024-04-26T12:10:11.434344+0000","last_active":"2024-04-26T12:10:26.885643+0000","last_peered":"2024-04-26T12:10:26.885643+0000","last_clean":"2024-04-26T12:10:26.885643+0000","last_became_active":"2024-04-26T12:10:11.434083+0000","last_became_peered":"2024-04-26T12:10:11.434083+0000","last_unstale":"2024-04-26T12:10:26.885643+0000","last_undegraded":"2024-04-26T12:10:26.885643+0000","last_fullsized":"2024-04-26T12:10:26.885643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3039,"log_dups_size":0,"ondisk_log_size":3039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:10.861891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199163904,"num_objects":3039,"num_object_clones":0,"num_object_copies":6078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3039,"num_write_kb":194496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926534+0000","last_change":"2024-04-26T12:09:48.932688+0000","last_active":"2024-04-26T12:10:21.926534+0000","last_peered":"2024-04-26T12:10:21.926534+0000","last_clean":"2024-04-26T12:10:21.926534+0000","last_became_active":"2024-04-26T12:09:48.932093+0000","last_became_peered":"2024-04-26T12:09:48.932093+0000","last_unstale":"2024-04-26T12:10:21.926534+0000","last_undegraded":"2024-04-26T12:10:21.926534+0000","last_fullsized":"2024-04-26T12:10:21.926534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926724+0000","last_change":"2024-04-26T12:09:49.378782+0000","last_active":"2024-04-26T12:10:21.926724+0000","last_peered":"2024-04-26T12:10:21.926724+0000","last_clean":"2024-04-26T12:10:21.926724+0000","last_became_active":"2024-04-26T12:09:49.378433+0000","last_became_peered":"2024-04-26T12:09:49.378433+0000","last_unstale":"2024-04-26T12:10:21.926724+0000","last_undegraded":"2024-04-26T12:10:21.926724+0000","last_fullsized":"2024-04-26T12:10:21.926724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"24'3077","reported_seq":3091,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.865822+0000","last_change":"2024-04-26T12:10:11.431163+0000","last_active":"2024-04-26T12:10:26.865822+0000","last_peered":"2024-04-26T12:10:26.865822+0000","last_clean":"2024-04-26T12:10:26.865822+0000","last_became_active":"2024-04-26T12:10:11.430885+0000","last_became_peered":"2024-04-26T12:10:11.430885+0000","last_unstale":"2024-04-26T12:10:26.865822+0000","last_undegraded":"2024-04-26T12:10:26.865822+0000","last_fullsized":"2024-04-26T12:10:26.865822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3077,"log_dups_size":0,"ondisk_log_size":3077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:35.287910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201654272,"num_objects":3077,"num_object_clones":0,"num_object_copies":6154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3077,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3077,"num_write_kb":196928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921360+0000","last_change":"2024-04-26T12:09:48.930427+0000","last_active":"2024-04-26T12:10:21.921360+0000","last_peered":"2024-04-26T12:10:21.921360+0000","last_clean":"2024-04-26T12:10:21.921360+0000","last_became_active":"2024-04-26T12:09:48.929711+0000","last_became_peered":"2024-04-26T12:09:48.929711+0000","last_unstale":"2024-04-26T12:10:21.921360+0000","last_undegraded":"2024-04-26T12:10:21.921360+0000","last_fullsized":"2024-04-26T12:10:21.921360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926306+0000","last_change":"2024-04-26T12:09:49.376074+0000","last_active":"2024-04-26T12:10:21.926306+0000","last_peered":"2024-04-26T12:10:21.926306+0000","last_clean":"2024-04-26T12:10:21.926306+0000","last_became_active":"2024-04-26T12:09:49.374120+0000","last_became_peered":"2024-04-26T12:09:49.374120+0000","last_unstale":"2024-04-26T12:10:21.926306+0000","last_undegraded":"2024-04-26T12:10:21.926306+0000","last_fullsized":"2024-04-26T12:10:21.926306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"24'2993","reported_seq":3008,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.878579+0000","last_change":"2024-04-26T12:10:11.429635+0000","last_active":"2024-04-26T12:10:26.878579+0000","last_peered":"2024-04-26T12:10:26.878579+0000","last_clean":"2024-04-26T12:10:26.878579+0000","last_became_active":"2024-04-26T12:10:11.429219+0000","last_became_peered":"2024-04-26T12:10:11.429219+0000","last_unstale":"2024-04-26T12:10:26.878579+0000","last_undegraded":"2024-04-26T12:10:26.878579+0000","last_fullsized":"2024-04-26T12:10:26.878579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2993,"log_dups_size":0,"ondisk_log_size":2993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:38.187521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196149248,"num_objects":2993,"num_object_clones":0,"num_object_copies":5986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2993,"num_write_kb":191552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921608+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:10:21.921608+0000","last_peered":"2024-04-26T12:10:21.921608+0000","last_clean":"2024-04-26T12:10:21.921608+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:10:21.921608+0000","last_undegraded":"2024-04-26T12:10:21.921608+0000","last_fullsized":"2024-04-26T12:10:21.921608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927459+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:10:21.927459+0000","last_peered":"2024-04-26T12:10:21.927459+0000","last_clean":"2024-04-26T12:10:21.927459+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:10:21.927459+0000","last_undegraded":"2024-04-26T12:10:21.927459+0000","last_fullsized":"2024-04-26T12:10:21.927459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"24'3008","reported_seq":3023,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.857795+0000","last_change":"2024-04-26T12:10:11.430983+0000","last_active":"2024-04-26T12:10:26.857795+0000","last_peered":"2024-04-26T12:10:26.857795+0000","last_clean":"2024-04-26T12:10:26.857795+0000","last_became_active":"2024-04-26T12:10:11.430706+0000","last_became_peered":"2024-04-26T12:10:11.430706+0000","last_unstale":"2024-04-26T12:10:26.857795+0000","last_undegraded":"2024-04-26T12:10:26.857795+0000","last_fullsized":"2024-04-26T12:10:26.857795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3008,"log_dups_size":0,"ondisk_log_size":3008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:15.449895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":3008,"num_object_clones":0,"num_object_copies":6016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3008,"num_write_kb":192512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927375+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:10:21.927375+0000","last_peered":"2024-04-26T12:10:21.927375+0000","last_clean":"2024-04-26T12:10:21.927375+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:10:21.927375+0000","last_undegraded":"2024-04-26T12:10:21.927375+0000","last_fullsized":"2024-04-26T12:10:21.927375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921904+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:10:21.921904+0000","last_peered":"2024-04-26T12:10:21.921904+0000","last_clean":"2024-04-26T12:10:21.921904+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:10:21.921904+0000","last_undegraded":"2024-04-26T12:10:21.921904+0000","last_fullsized":"2024-04-26T12:10:21.921904+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.928208+0000","last_change":"2024-04-26T12:09:49.381960+0000","last_active":"2024-04-26T12:10:21.928208+0000","last_peered":"2024-04-26T12:10:21.928208+0000","last_clean":"2024-04-26T12:10:21.928208+0000","last_became_active":"2024-04-26T12:09:49.381382+0000","last_became_peered":"2024-04-26T12:09:49.381382+0000","last_unstale":"2024-04-26T12:10:21.928208+0000","last_undegraded":"2024-04-26T12:10:21.928208+0000","last_fullsized":"2024-04-26T12:10:21.928208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"24'3037","reported_seq":3052,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.883032+0000","last_change":"2024-04-26T12:10:11.429881+0000","last_active":"2024-04-26T12:10:26.883032+0000","last_peered":"2024-04-26T12:10:26.883032+0000","last_clean":"2024-04-26T12:10:26.883032+0000","last_became_active":"2024-04-26T12:10:11.429451+0000","last_became_peered":"2024-04-26T12:10:11.429451+0000","last_unstale":"2024-04-26T12:10:26.883032+0000","last_undegraded":"2024-04-26T12:10:26.883032+0000","last_fullsized":"2024-04-26T12:10:26.883032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3037,"log_dups_size":0,"ondisk_log_size":3037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:35.287910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199032832,"num_objects":3037,"num_object_clones":0,"num_object_copies":6074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3037,"num_write_kb":194368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922024+0000","last_change":"2024-04-26T12:09:43.909487+0000","last_active":"2024-04-26T12:10:21.922024+0000","last_peered":"2024-04-26T12:10:21.922024+0000","last_clean":"2024-04-26T12:10:21.922024+0000","last_became_active":"2024-04-26T12:09:43.909061+0000","last_became_peered":"2024-04-26T12:09:43.909061+0000","last_unstale":"2024-04-26T12:10:21.922024+0000","last_undegraded":"2024-04-26T12:10:21.922024+0000","last_fullsized":"2024-04-26T12:10:21.922024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927419+0000","last_change":"2024-04-26T12:09:48.934185+0000","last_active":"2024-04-26T12:10:21.927419+0000","last_peered":"2024-04-26T12:10:21.927419+0000","last_clean":"2024-04-26T12:10:21.927419+0000","last_became_active":"2024-04-26T12:09:48.933963+0000","last_became_peered":"2024-04-26T12:09:48.933963+0000","last_unstale":"2024-04-26T12:10:21.927419+0000","last_undegraded":"2024-04-26T12:10:21.927419+0000","last_fullsized":"2024-04-26T12:10:21.927419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:01.046114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921511+0000","last_change":"2024-04-26T12:09:49.377690+0000","last_active":"2024-04-26T12:10:21.921511+0000","last_peered":"2024-04-26T12:10:21.921511+0000","last_clean":"2024-04-26T12:10:21.921511+0000","last_became_active":"2024-04-26T12:09:49.377175+0000","last_became_peered":"2024-04-26T12:09:49.377175+0000","last_unstale":"2024-04-26T12:10:21.921511+0000","last_undegraded":"2024-04-26T12:10:21.921511+0000","last_fullsized":"2024-04-26T12:10:21.921511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:56.339584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"24'3064","reported_seq":3078,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.872626+0000","last_change":"2024-04-26T12:10:11.430831+0000","last_active":"2024-04-26T12:10:26.872626+0000","last_peered":"2024-04-26T12:10:26.872626+0000","last_clean":"2024-04-26T12:10:26.872626+0000","last_became_active":"2024-04-26T12:10:11.430634+0000","last_became_peered":"2024-04-26T12:10:11.430634+0000","last_unstale":"2024-04-26T12:10:26.872626+0000","last_undegraded":"2024-04-26T12:10:26.872626+0000","last_fullsized":"2024-04-26T12:10:26.872626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3064,"log_dups_size":0,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:40.106309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200802304,"num_objects":3064,"num_object_clones":0,"num_object_copies":6128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":196096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927368+0000","last_change":"2024-04-26T12:09:43.909201+0000","last_active":"2024-04-26T12:10:21.927368+0000","last_peered":"2024-04-26T12:10:21.927368+0000","last_clean":"2024-04-26T12:10:21.927368+0000","last_became_active":"2024-04-26T12:09:43.908920+0000","last_became_peered":"2024-04-26T12:09:43.908920+0000","last_unstale":"2024-04-26T12:10:21.927368+0000","last_undegraded":"2024-04-26T12:10:21.927368+0000","last_fullsized":"2024-04-26T12:10:21.927368+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:59.367262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":218,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924212+0000","last_change":"2024-04-26T12:09:44.910055+0000","last_active":"2024-04-26T12:10:21.924212+0000","last_peered":"2024-04-26T12:10:21.924212+0000","last_clean":"2024-04-26T12:10:21.924212+0000","last_became_active":"2024-04-26T12:09:44.909230+0000","last_became_peered":"2024-04-26T12:09:44.909230+0000","last_unstale":"2024-04-26T12:10:21.924212+0000","last_undegraded":"2024-04-26T12:10:21.924212+0000","last_fullsized":"2024-04-26T12:10:21.924212+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:03.474929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926702+0000","last_change":"2024-04-26T12:09:48.934686+0000","last_active":"2024-04-26T12:10:21.926702+0000","last_peered":"2024-04-26T12:10:21.926702+0000","last_clean":"2024-04-26T12:10:21.926702+0000","last_became_active":"2024-04-26T12:09:48.934432+0000","last_became_peered":"2024-04-26T12:09:48.934432+0000","last_unstale":"2024-04-26T12:10:21.926702+0000","last_undegraded":"2024-04-26T12:10:21.926702+0000","last_fullsized":"2024-04-26T12:10:21.926702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922430+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:10:21.922430+0000","last_peered":"2024-04-26T12:10:21.922430+0000","last_clean":"2024-04-26T12:10:21.922430+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:10:21.922430+0000","last_undegraded":"2024-04-26T12:10:21.922430+0000","last_fullsized":"2024-04-26T12:10:21.922430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"24'2930","reported_seq":2945,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.881071+0000","last_change":"2024-04-26T12:10:11.434367+0000","last_active":"2024-04-26T12:10:26.881071+0000","last_peered":"2024-04-26T12:10:26.881071+0000","last_clean":"2024-04-26T12:10:26.881071+0000","last_became_active":"2024-04-26T12:10:11.434114+0000","last_became_peered":"2024-04-26T12:10:11.434114+0000","last_unstale":"2024-04-26T12:10:26.881071+0000","last_undegraded":"2024-04-26T12:10:26.881071+0000","last_fullsized":"2024-04-26T12:10:26.881071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2930,"log_dups_size":0,"ondisk_log_size":2930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:36.884809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192020480,"num_objects":2930,"num_object_clones":0,"num_object_copies":5860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2930,"num_write_kb":187520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926644+0000","last_change":"2024-04-26T12:09:43.909596+0000","last_active":"2024-04-26T12:10:21.926644+0000","last_peered":"2024-04-26T12:10:21.926644+0000","last_clean":"2024-04-26T12:10:21.926644+0000","last_became_active":"2024-04-26T12:09:43.908859+0000","last_became_peered":"2024-04-26T12:09:43.908859+0000","last_unstale":"2024-04-26T12:10:21.926644+0000","last_undegraded":"2024-04-26T12:10:21.926644+0000","last_fullsized":"2024-04-26T12:10:21.926644+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:38.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921497+0000","last_change":"2024-04-26T12:09:48.930820+0000","last_active":"2024-04-26T12:10:21.921497+0000","last_peered":"2024-04-26T12:10:21.921497+0000","last_clean":"2024-04-26T12:10:21.921497+0000","last_became_active":"2024-04-26T12:09:48.930337+0000","last_became_peered":"2024-04-26T12:09:48.930337+0000","last_unstale":"2024-04-26T12:10:21.921497+0000","last_undegraded":"2024-04-26T12:10:21.921497+0000","last_fullsized":"2024-04-26T12:10:21.921497+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927907+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:10:21.927907+0000","last_peered":"2024-04-26T12:10:21.927907+0000","last_clean":"2024-04-26T12:10:21.927907+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:10:21.927907+0000","last_undegraded":"2024-04-26T12:10:21.927907+0000","last_fullsized":"2024-04-26T12:10:21.927907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"24'3077","reported_seq":3091,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.857803+0000","last_change":"2024-04-26T12:10:11.429705+0000","last_active":"2024-04-26T12:10:26.857803+0000","last_peered":"2024-04-26T12:10:26.857803+0000","last_clean":"2024-04-26T12:10:26.857803+0000","last_became_active":"2024-04-26T12:10:11.429362+0000","last_became_peered":"2024-04-26T12:10:11.429362+0000","last_unstale":"2024-04-26T12:10:26.857803+0000","last_undegraded":"2024-04-26T12:10:26.857803+0000","last_fullsized":"2024-04-26T12:10:26.857803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3077,"log_dups_size":0,"ondisk_log_size":3077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:09.943243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201654272,"num_objects":3077,"num_object_clones":0,"num_object_copies":6154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3077,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3077,"num_write_kb":196928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924404+0000","last_change":"2024-04-26T12:09:43.911726+0000","last_active":"2024-04-26T12:10:21.924404+0000","last_peered":"2024-04-26T12:10:21.924404+0000","last_clean":"2024-04-26T12:10:21.924404+0000","last_became_active":"2024-04-26T12:09:43.911481+0000","last_became_peered":"2024-04-26T12:09:43.911481+0000","last_unstale":"2024-04-26T12:10:21.924404+0000","last_undegraded":"2024-04-26T12:10:21.924404+0000","last_fullsized":"2024-04-26T12:10:21.924404+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:51.906301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.928148+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:10:21.928148+0000","last_peered":"2024-04-26T12:10:21.928148+0000","last_clean":"2024-04-26T12:10:21.928148+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:10:21.928148+0000","last_undegraded":"2024-04-26T12:10:21.928148+0000","last_fullsized":"2024-04-26T12:10:21.928148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926405+0000","last_change":"2024-04-26T12:09:49.377685+0000","last_active":"2024-04-26T12:10:21.926405+0000","last_peered":"2024-04-26T12:10:21.926405+0000","last_clean":"2024-04-26T12:10:21.926405+0000","last_became_active":"2024-04-26T12:09:49.375111+0000","last_became_peered":"2024-04-26T12:09:49.375111+0000","last_unstale":"2024-04-26T12:10:21.926405+0000","last_undegraded":"2024-04-26T12:10:21.926405+0000","last_fullsized":"2024-04-26T12:10:21.926405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"24'2940","reported_seq":2955,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.879904+0000","last_change":"2024-04-26T12:10:11.434440+0000","last_active":"2024-04-26T12:10:26.879904+0000","last_peered":"2024-04-26T12:10:26.879904+0000","last_clean":"2024-04-26T12:10:26.879904+0000","last_became_active":"2024-04-26T12:10:11.434166+0000","last_became_peered":"2024-04-26T12:10:11.434166+0000","last_unstale":"2024-04-26T12:10:26.879904+0000","last_undegraded":"2024-04-26T12:10:26.879904+0000","last_fullsized":"2024-04-26T12:10:26.879904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:46.349820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192675840,"num_objects":2940,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2940,"num_write_kb":188160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921358+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:10:21.921358+0000","last_peered":"2024-04-26T12:10:21.921358+0000","last_clean":"2024-04-26T12:10:21.921358+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:10:21.921358+0000","last_undegraded":"2024-04-26T12:10:21.921358+0000","last_fullsized":"2024-04-26T12:10:21.921358+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924583+0000","last_change":"2024-04-26T12:09:48.933094+0000","last_active":"2024-04-26T12:10:21.924583+0000","last_peered":"2024-04-26T12:10:21.924583+0000","last_clean":"2024-04-26T12:10:21.924583+0000","last_became_active":"2024-04-26T12:09:48.932734+0000","last_became_peered":"2024-04-26T12:09:48.932734+0000","last_unstale":"2024-04-26T12:10:21.924583+0000","last_undegraded":"2024-04-26T12:10:21.924583+0000","last_fullsized":"2024-04-26T12:10:21.924583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:03.090800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927634+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:10:21.927634+0000","last_peered":"2024-04-26T12:10:21.927634+0000","last_clean":"2024-04-26T12:10:21.927634+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:10:21.927634+0000","last_undegraded":"2024-04-26T12:10:21.927634+0000","last_fullsized":"2024-04-26T12:10:21.927634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"24'2967","reported_seq":2982,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.873557+0000","last_change":"2024-04-26T12:10:11.429909+0000","last_active":"2024-04-26T12:10:26.873557+0000","last_peered":"2024-04-26T12:10:26.873557+0000","last_clean":"2024-04-26T12:10:26.873557+0000","last_became_active":"2024-04-26T12:10:11.429647+0000","last_became_peered":"2024-04-26T12:10:11.429647+0000","last_unstale":"2024-04-26T12:10:26.873557+0000","last_undegraded":"2024-04-26T12:10:26.873557+0000","last_fullsized":"2024-04-26T12:10:26.873557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":2967,"log_dups_size":0,"ondisk_log_size":2967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:09.943243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194445312,"num_objects":2967,"num_object_clones":0,"num_object_copies":5934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2967,"num_write_kb":189888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922222+0000","last_change":"2024-04-26T12:09:43.909440+0000","last_active":"2024-04-26T12:10:21.922222+0000","last_peered":"2024-04-26T12:10:21.922222+0000","last_clean":"2024-04-26T12:10:21.922222+0000","last_became_active":"2024-04-26T12:09:43.909039+0000","last_became_peered":"2024-04-26T12:09:43.909039+0000","last_unstale":"2024-04-26T12:10:21.922222+0000","last_undegraded":"2024-04-26T12:10:21.922222+0000","last_fullsized":"2024-04-26T12:10:21.922222+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927787+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:10:21.927787+0000","last_peered":"2024-04-26T12:10:21.927787+0000","last_clean":"2024-04-26T12:10:21.927787+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:10:21.927787+0000","last_undegraded":"2024-04-26T12:10:21.927787+0000","last_fullsized":"2024-04-26T12:10:21.927787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921576+0000","last_change":"2024-04-26T12:09:49.369820+0000","last_active":"2024-04-26T12:10:21.921576+0000","last_peered":"2024-04-26T12:10:21.921576+0000","last_clean":"2024-04-26T12:10:21.921576+0000","last_became_active":"2024-04-26T12:09:49.369433+0000","last_became_peered":"2024-04-26T12:09:49.369433+0000","last_unstale":"2024-04-26T12:10:21.921576+0000","last_undegraded":"2024-04-26T12:10:21.921576+0000","last_fullsized":"2024-04-26T12:10:21.921576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:05.240399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"24'3113","reported_seq":3128,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T12:10:26.880470+0000","last_change":"2024-04-26T12:10:11.434353+0000","last_active":"2024-04-26T12:10:26.880470+0000","last_peered":"2024-04-26T12:10:26.880470+0000","last_clean":"2024-04-26T12:10:26.880470+0000","last_became_active":"2024-04-26T12:10:11.434121+0000","last_became_peered":"2024-04-26T12:10:11.434121+0000","last_unstale":"2024-04-26T12:10:26.880470+0000","last_undegraded":"2024-04-26T12:10:26.880470+0000","last_fullsized":"2024-04-26T12:10:26.880470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:10:10.413205+0000","last_clean_scrub_stamp":"2024-04-26T12:10:10.413205+0000","objects_scrubbed":0,"log_size":3113,"log_dups_size":0,"ondisk_log_size":3113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:44.309245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204013568,"num_objects":3113,"num_object_clones":0,"num_object_copies":6226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3113,"num_write_kb":199232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.925002+0000","last_change":"2024-04-26T12:09:43.909117+0000","last_active":"2024-04-26T12:10:21.925002+0000","last_peered":"2024-04-26T12:10:21.925002+0000","last_clean":"2024-04-26T12:10:21.925002+0000","last_became_active":"2024-04-26T12:09:43.908856+0000","last_became_peered":"2024-04-26T12:09:43.908856+0000","last_unstale":"2024-04-26T12:10:21.925002+0000","last_undegraded":"2024-04-26T12:10:21.925002+0000","last_fullsized":"2024-04-26T12:10:21.925002+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:08.097519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926263+0000","last_change":"2024-04-26T12:09:48.932875+0000","last_active":"2024-04-26T12:10:21.926263+0000","last_peered":"2024-04-26T12:10:21.926263+0000","last_clean":"2024-04-26T12:10:21.926263+0000","last_became_active":"2024-04-26T12:09:48.932116+0000","last_became_peered":"2024-04-26T12:09:48.932116+0000","last_unstale":"2024-04-26T12:10:21.926263+0000","last_undegraded":"2024-04-26T12:10:21.926263+0000","last_fullsized":"2024-04-26T12:10:21.926263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921582+0000","last_change":"2024-04-26T12:09:49.377514+0000","last_active":"2024-04-26T12:10:21.921582+0000","last_peered":"2024-04-26T12:10:21.921582+0000","last_clean":"2024-04-26T12:10:21.921582+0000","last_became_active":"2024-04-26T12:09:49.376974+0000","last_became_peered":"2024-04-26T12:09:49.376974+0000","last_unstale":"2024-04-26T12:10:21.921582+0000","last_undegraded":"2024-04-26T12:10:21.921582+0000","last_fullsized":"2024-04-26T12:10:21.921582+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:20.735150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921699+0000","last_change":"2024-04-26T12:09:48.930874+0000","last_active":"2024-04-26T12:10:21.921699+0000","last_peered":"2024-04-26T12:10:21.921699+0000","last_clean":"2024-04-26T12:10:21.921699+0000","last_became_active":"2024-04-26T12:09:48.930470+0000","last_became_peered":"2024-04-26T12:09:48.930470+0000","last_unstale":"2024-04-26T12:10:21.921699+0000","last_undegraded":"2024-04-26T12:10:21.921699+0000","last_fullsized":"2024-04-26T12:10:21.921699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922314+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:10:21.922314+0000","last_peered":"2024-04-26T12:10:21.922314+0000","last_clean":"2024-04-26T12:10:21.922314+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:10:21.922314+0000","last_undegraded":"2024-04-26T12:10:21.922314+0000","last_fullsized":"2024-04-26T12:10:21.922314+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924821+0000","last_change":"2024-04-26T12:09:48.932679+0000","last_active":"2024-04-26T12:10:21.924821+0000","last_peered":"2024-04-26T12:10:21.924821+0000","last_clean":"2024-04-26T12:10:21.924821+0000","last_became_active":"2024-04-26T12:09:48.932276+0000","last_became_peered":"2024-04-26T12:09:48.932276+0000","last_unstale":"2024-04-26T12:10:21.924821+0000","last_undegraded":"2024-04-26T12:10:21.924821+0000","last_fullsized":"2024-04-26T12:10:21.924821+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:33.617265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924583+0000","last_change":"2024-04-26T12:09:49.374856+0000","last_active":"2024-04-26T12:10:21.924583+0000","last_peered":"2024-04-26T12:10:21.924583+0000","last_clean":"2024-04-26T12:10:21.924583+0000","last_became_active":"2024-04-26T12:09:49.373045+0000","last_became_peered":"2024-04-26T12:09:49.373045+0000","last_unstale":"2024-04-26T12:10:21.924583+0000","last_undegraded":"2024-04-26T12:10:21.924583+0000","last_fullsized":"2024-04-26T12:10:21.924583+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926182+0000","last_change":"2024-04-26T12:10:12.430661+0000","last_active":"2024-04-26T12:10:21.926182+0000","last_peered":"2024-04-26T12:10:21.926182+0000","last_clean":"2024-04-26T12:10:21.926182+0000","last_became_active":"2024-04-26T12:10:12.430427+0000","last_became_peered":"2024-04-26T12:10:12.430427+0000","last_unstale":"2024-04-26T12:10:21.926182+0000","last_undegraded":"2024-04-26T12:10:21.926182+0000","last_fullsized":"2024-04-26T12:10:21.926182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:21.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926572+0000","last_change":"2024-04-26T12:09:49.370664+0000","last_active":"2024-04-26T12:10:21.926572+0000","last_peered":"2024-04-26T12:10:21.926572+0000","last_clean":"2024-04-26T12:10:21.926572+0000","last_became_active":"2024-04-26T12:09:49.369732+0000","last_became_peered":"2024-04-26T12:09:49.369732+0000","last_unstale":"2024-04-26T12:10:21.926572+0000","last_undegraded":"2024-04-26T12:10:21.926572+0000","last_fullsized":"2024-04-26T12:10:21.926572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927328+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:10:21.927328+0000","last_peered":"2024-04-26T12:10:21.927328+0000","last_clean":"2024-04-26T12:10:21.927328+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:10:21.927328+0000","last_undegraded":"2024-04-26T12:10:21.927328+0000","last_fullsized":"2024-04-26T12:10:21.927328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921995+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:10:21.921995+0000","last_peered":"2024-04-26T12:10:21.921995+0000","last_clean":"2024-04-26T12:10:21.921995+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:10:21.921995+0000","last_undegraded":"2024-04-26T12:10:21.921995+0000","last_fullsized":"2024-04-26T12:10:21.921995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927548+0000","last_change":"2024-04-26T12:09:48.934987+0000","last_active":"2024-04-26T12:10:21.927548+0000","last_peered":"2024-04-26T12:10:21.927548+0000","last_clean":"2024-04-26T12:10:21.927548+0000","last_became_active":"2024-04-26T12:09:48.934043+0000","last_became_peered":"2024-04-26T12:09:48.934043+0000","last_unstale":"2024-04-26T12:10:21.927548+0000","last_undegraded":"2024-04-26T12:10:21.927548+0000","last_fullsized":"2024-04-26T12:10:21.927548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:02.308630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924328+0000","last_change":"2024-04-26T12:09:49.376373+0000","last_active":"2024-04-26T12:10:21.924328+0000","last_peered":"2024-04-26T12:10:21.924328+0000","last_clean":"2024-04-26T12:10:21.924328+0000","last_became_active":"2024-04-26T12:09:49.373300+0000","last_became_peered":"2024-04-26T12:09:49.373300+0000","last_unstale":"2024-04-26T12:10:21.924328+0000","last_undegraded":"2024-04-26T12:10:21.924328+0000","last_fullsized":"2024-04-26T12:10:21.924328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.924233+0000","last_change":"2024-04-26T12:09:49.379724+0000","last_active":"2024-04-26T12:10:21.924233+0000","last_peered":"2024-04-26T12:10:21.924233+0000","last_clean":"2024-04-26T12:10:21.924233+0000","last_became_active":"2024-04-26T12:09:49.378818+0000","last_became_peered":"2024-04-26T12:09:49.378818+0000","last_unstale":"2024-04-26T12:10:21.924233+0000","last_undegraded":"2024-04-26T12:10:21.924233+0000","last_fullsized":"2024-04-26T12:10:21.924233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:48.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.926778+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:10:21.926778+0000","last_peered":"2024-04-26T12:10:21.926778+0000","last_clean":"2024-04-26T12:10:21.926778+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:10:21.926778+0000","last_undegraded":"2024-04-26T12:10:21.926778+0000","last_fullsized":"2024-04-26T12:10:21.926778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.921982+0000","last_change":"2024-04-26T12:09:49.369890+0000","last_active":"2024-04-26T12:10:21.921982+0000","last_peered":"2024-04-26T12:10:21.921982+0000","last_clean":"2024-04-26T12:10:21.921982+0000","last_became_active":"2024-04-26T12:09:49.369543+0000","last_became_peered":"2024-04-26T12:09:49.369543+0000","last_unstale":"2024-04-26T12:10:21.921982+0000","last_undegraded":"2024-04-26T12:10:21.921982+0000","last_fullsized":"2024-04-26T12:10:21.921982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:52.771455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.927568+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:10:21.927568+0000","last_peered":"2024-04-26T12:10:21.927568+0000","last_clean":"2024-04-26T12:10:21.927568+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:10:21.927568+0000","last_undegraded":"2024-04-26T12:10:21.927568+0000","last_fullsized":"2024-04-26T12:10:21.927568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T12:10:21.922325+0000","last_change":"2024-04-26T12:09:49.370440+0000","last_active":"2024-04-26T12:10:21.922325+0000","last_peered":"2024-04-26T12:10:21.922325+0000","last_clean":"2024-04-26T12:10:21.922325+0000","last_became_active":"2024-04-26T12:09:49.369520+0000","last_became_peered":"2024-04-26T12:09:49.369520+0000","last_unstale":"2024-04-26T12:10:21.922325+0000","last_undegraded":"2024-04-26T12:10:21.922325+0000","last_fullsized":"2024-04-26T12:10:21.922325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:26.647757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3142320128,"num_objects":47948,"num_object_clones":0,"num_object_copies":95896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47948,"num_write_kb":3068672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6285426688,"data_stored":6285426688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47948,"ondisk_log_size":47948,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2444988,"kb_used_data":2369584,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":91926852,"statfs":{"total":96636764160,"available":94133096448,"internally_reserved":0,"allocated":2426454016,"data_stored":2426295820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1878036,"kb_used_data":1824780,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":92493804,"statfs":{"total":96636764160,"available":94713655296,"internally_reserved":0,"allocated":1868574720,"data_stored":1868390142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1713740,"kb_used_data":1664516,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":92658100,"statfs":{"total":96636764160,"available":94881894400,"internally_reserved":0,"allocated":1704464384,"data_stored":1704287382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1967128576,"data_stored":1967128576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1762525184,"data_stored":1762525184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2555772928,"data_stored":2555772928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:10:28.055 INFO:tasks.thrashosds.thrasher:Setting 3.11 to [0, 1, 2] 2024-04-26T12:10:28.055 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.11', '0', '1', '2'] 2024-04-26T12:10:28.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.11 0 1 2 2024-04-26T12:10:28.141 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:28.140+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:28.234 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:28.234 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:28.242 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:28.240+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:28.247 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:28.343 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:28.342+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:28.444 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:28.442+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:28.468 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:28.468 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:28.484 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T12:10:28.510 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:10:28.510 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T12:10:28.545 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:28.544+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:28.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 16 16 52314 52298 204.266 162.25 0.00613335 0.00489202 2024-04-26T12:10:28.646 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:28.644+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:28.657 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:28.657 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:28.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:28.747 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:28.745+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:28.847 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:28.847+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:28.862 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:28.863 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:28.874 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:28.949 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:28.948+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.050 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:29.048+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:29.097 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:29.097 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:29.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:29.150 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:29.149+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.250 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:29.250+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.297 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:29.297 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:29.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:29.351 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:29.349+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:29.452 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:29.451+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.490 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:29.490 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:29.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:29.553 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:29.551+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:29.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 17 16 54616 54600 200.712 143.875 0.00401264 0.00497854 2024-04-26T12:10:29.653 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:29.653+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.724 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:29.724 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:29.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:29.782 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:29.778+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.855 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:29.853+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:29.954 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:29.954 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:29.958 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:29.957+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:29.968 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:30.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:10:30.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:30.058 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:30.057+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:30.146 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:30.146 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:30.158 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:30.156+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:30.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:30.259 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:30.257+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:30.265 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:30.287 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:30.308 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:30.333 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:30.333 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:30.333 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:30.333 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:30.333 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:30.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:30.360 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:30.358+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:30.460 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:30.458+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34842 5.b 5:d6f421a9:::benchmark_data_smithi045_43640_object34841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:30.524 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.5403305389999993, 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014832164, 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34842 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981061+0000", 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981194+0000", 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013305899999999999 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981201+0000", 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4440000000000002e-06 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981207+0000", 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1689999999999997e-06 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982376+0000", 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001168531 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982492+0000", 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116359 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982618+0000", 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000125387 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.984635+0000", 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020174680000000001 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995828+0000", 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011192366 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995871+0000", 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3260000000000003e-05 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995893+0000", 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2554000000000001e-05 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:34848 5.4 5:2a4916b0:::benchmark_data_smithi045_43640_object34847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.5400546810000009, 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014588217000000001, 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.530 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 34848 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:30.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981337+0000", 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981465+0000", 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012813200000000001 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981473+0000", 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6470000000000004e-06 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.981480+0000", 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5200000000000003e-06 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982512+0000", 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010321250000000001 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982619+0000", 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107509 2024-04-26T12:10:30.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.982736+0000", 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116821 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.985587+0000", 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002851124 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995838+0000", 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010250987 2024-04-26T12:10:30.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995889+0000", 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0865999999999997e-05 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:21.995925+0000", 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5991999999999997e-05 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.535 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:45554 5.e 5:7a7db317:::benchmark_data_smithi045_43640_object45553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5798365939999996, 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01544209, 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 45554 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941555+0000", 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941613+0000", 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8433000000000001e-05 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941618+0000", 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5010000000000004e-06 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941622+0000", 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7290000000000002e-06 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941714+0000", 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1539000000000006e-05 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941814+0000", 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010071 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.941945+0000", 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013045099999999999 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.942986+0000", 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001041401 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.956912+0000", 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013925379 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.956960+0000", 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8199999999999999e-05 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:25.956997+0000", 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7317000000000002e-05 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:46628 5.e 5:78c4d412:::benchmark_data_smithi045_43640_object46627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.1709463229999999, 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014366868, 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.541 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 46628 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350445+0000", 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350494+0000", 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9835e-05 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350507+0000", 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2798e-05 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.350516+0000", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1339999999999993e-06 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.353559+0000", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003042927 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.353653+0000", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3852999999999997e-05 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.353737+0000", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3846999999999999e-05 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.354711+0000", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00097387899999999998 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.364745+0000", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010034569 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.364789+0000", 2024-04-26T12:10:30.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3247000000000001e-05 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.364812+0000", 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3614000000000001e-05 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:46873 5.4 5:24eedf29:::benchmark_data_smithi045_43640_object46872:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.444988+0000", 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0764039170000004, 2024-04-26T12:10:30.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015783194, 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 46873 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.444988+0000", 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.444988+0000", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.444987+0000", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.445019+0000", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1537e-05 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.445028+0000", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1940000000000004e-06 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.445035+0000", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1019999999999999e-06 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446478+0000", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001443415 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446593+0000", 2024-04-26T12:10:30.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000114218 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446719+0000", 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000126542 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.449927+0000", 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032083860000000001 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.460697+0000", 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010769793 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.460740+0000", 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2376999999999998e-05 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.460771+0000", 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1352000000000001e-05 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:46878 5.4 5:21080f2a:::benchmark_data_smithi045_43640_object46877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.446063+0000", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.07532899, 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014833425000000001, 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 46878 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446063+0000", 2024-04-26T12:10:30.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446063+0000", 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446062+0000", 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446132+0000", 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0358000000000006e-05 2024-04-26T12:10:30.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446144+0000", 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2097e-05 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.446152+0000", 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.525e-06 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.447933+0000", 2024-04-26T12:10:30.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017813600000000001 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.448024+0000", 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1016999999999999e-05 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.448117+0000", 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.449937+0000", 2024-04-26T12:10:30.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018200600000000001 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.460816+0000", 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010878897 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.460864+0000", 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8838999999999998e-05 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.460896+0000", 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1662999999999998e-05 2024-04-26T12:10:30.556 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:47333 5.4 5:2aef9837:::benchmark_data_smithi045_43640_object47332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.630673+0000", 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.890718224, 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015669209999999999, 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 47333 2024-04-26T12:10:30.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630673+0000", 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630673+0000", 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630673+0000", 2024-04-26T12:10:30.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630715+0000", 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2033999999999998e-05 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630725+0000", 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0597999999999999e-05 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630732+0000", 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:10:30.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630760+0000", 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7878999999999999e-05 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.630879+0000", 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000118291 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631007+0000", 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000128548 2024-04-26T12:10:30.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633566+0000", 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0025584129999999998 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.646263+0000", 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012697132 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.646307+0000", 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4251e-05 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.646343+0000", 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5794000000000003e-05 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:47340 5.4 5:23eb3ff8:::benchmark_data_smithi045_43640_object47339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.631552+0000", 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.8898393640000002, 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014883406, 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.562 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 47340 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631552+0000", 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631552+0000", 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631552+0000", 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631603+0000", 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1394999999999998e-05 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631613+0000", 2024-04-26T12:10:30.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5189999999999998e-06 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.631620+0000", 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.632614+0000", 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00099455799999999999 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.632763+0000", 2024-04-26T12:10:30.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000149018 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.632853+0000", 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9757000000000001e-05 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.634634+0000", 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017806499999999999 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.646386+0000", 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011752301999999999 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.646415+0000", 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9232000000000001e-05 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.646436+0000", 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0432e-05 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:47341 5.4 5:2c8ff9ed:::benchmark_data_smithi045_43640_object47340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.633480+0000", 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.887911366, 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014500954999999999, 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 47341 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633480+0000", 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633480+0000", 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633480+0000", 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633538+0000", 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8307999999999998e-05 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633547+0000", 2024-04-26T12:10:30.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9460000000000004e-06 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633554+0000", 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.815e-06 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633588+0000", 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4304999999999998e-05 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633681+0000", 2024-04-26T12:10:30.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3017999999999996e-05 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.633766+0000", 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5113999999999999e-05 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.635212+0000", 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001446229 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.647918+0000", 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012705553 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.647951+0000", 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3000000000000003e-05 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.647981+0000", 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0323000000000001e-05 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.5977135159999998, 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48066 5.e 5:7af911c1:::benchmark_data_smithi045_43640_object48065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.5954224200000002, 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017632022000000001, 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48066 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925968+0000", 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926028+0000", 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9240999999999997e-05 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926038+0000", 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0658e-05 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926046+0000", 2024-04-26T12:10:30.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928423+0000", 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023775649999999999 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928555+0000", 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131803 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928694+0000", 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013876599999999999 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930779+0000", 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020856389999999998 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943512+0000", 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012732579000000001 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943564+0000", 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1796999999999999e-05 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943601+0000", 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7635999999999997e-05 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48069 5.e 5:7a5607ab:::benchmark_data_smithi045_43640_object48068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.927409+0000", 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.5939824499999999, 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016265255999999999, 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48069 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927409+0000", 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927409+0000", 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927409+0000", 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927488+0000", 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9110000000000007e-05 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927497+0000", 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7389999999999994e-06 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927503+0000", 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8250000000000001e-06 2024-04-26T12:10:30.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.929694+0000", 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021903669999999999 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.929824+0000", 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013003299999999999 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.929977+0000", 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015319800000000001 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.931064+0000", 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010868690000000001 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943630+0000", 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012566582 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943655+0000", 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4998999999999999e-05 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943675+0000", 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9222e-05 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.591 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48079 5.e 5:7d42ec23:::benchmark_data_smithi045_43640_object48078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.933064+0000", 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.5883274680000001, 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015393441000000001, 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48079 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933064+0000", 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933064+0000", 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933063+0000", 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933125+0000", 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1520999999999996e-05 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933137+0000", 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2048000000000001e-05 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933144+0000", 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4059999999999999e-06 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933174+0000", 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9694999999999999e-05 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933262+0000", 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8277999999999997e-05 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.933367+0000", 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104879 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.934675+0000", 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001308158 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.948372+0000", 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013697038999999999 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.948419+0000", 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6461999999999997e-05 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.948458+0000", 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8810999999999998e-05 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48093 5.e 5:7f987422:::benchmark_data_smithi045_43640_object48092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.939464+0000", 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.5819277229999997, 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014735319, 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.597 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48093 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.939464+0000", 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.939464+0000", 2024-04-26T12:10:30.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.939464+0000", 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.939494+0000", 2024-04-26T12:10:30.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0633000000000003e-05 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.939501+0000", 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1029999999999996e-06 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.939507+0000", 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1059999999999996e-06 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.940493+0000", 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00098520300000000003 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.940614+0000", 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012115 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.940749+0000", 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013572700000000001 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.942168+0000", 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001418117 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.954119+0000", 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011951623999999999 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.954163+0000", 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3875999999999998e-05 2024-04-26T12:10:30.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.954199+0000", 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6232999999999997e-05 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48204 5.4 5:2e474d3f:::benchmark_data_smithi045_43640_object48203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.5345882780000002, 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01638158, 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.603 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48204 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986886+0000", 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2893999999999996e-05 2024-04-26T12:10:30.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986895+0000", 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6490000000000003e-06 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986903+0000", 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.486e-06 2024-04-26T12:10:30.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986937+0000", 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3998000000000002e-05 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.987034+0000", 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6916999999999994e-05 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.987116+0000", 2024-04-26T12:10:30.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2508000000000004e-05 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.988821+0000", 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017053210000000001 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003108+0000", 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014286695 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003148+0000", 2024-04-26T12:10:30.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459000000000003e-05 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003185+0000", 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7369000000000001e-05 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48685 5.b 5:deb77a5f:::benchmark_data_smithi045_43640_object48684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.330398261, 2024-04-26T12:10:30.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017384601, 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48685 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.610 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191025+0000", 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2106000000000001e-05 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191031+0000", 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6039999999999998e-06 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191038+0000", 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4529999999999999e-06 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191062+0000", 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4256e-05 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191147+0000", 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4689000000000002e-05 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191278+0000", 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013082600000000001 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.193322+0000", 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002044438 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208334+0000", 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015012152000000001 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208359+0000", 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4765000000000001e-05 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208378+0000", 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8978e-05 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.614 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:50519 5.4 5:235748a0:::benchmark_data_smithi045_43640_object50518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:27.909661+0000", 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 2.611730245, 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015698075999999998, 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.615 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 50519 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.909661+0000", 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.909661+0000", 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.909661+0000", 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.909742+0000", 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1451000000000003e-05 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.909751+0000", 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8820000000000007e-06 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.909758+0000", 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.725e-06 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.911255+0000", 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014968729999999999 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.911366+0000", 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111455 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.911505+0000", 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000139068 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.914211+0000", 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0027056580000000001 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.925309+0000", 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011098175 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.925338+0000", 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9357999999999999e-05 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.925360+0000", 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1277e-05 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.620 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:56414 5.e 5:7c453076:::benchmark_data_smithi045_43640_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.349177+0000", 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17221473700000001, 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014595287, 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 56414 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.621 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349177+0000", 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349177+0000", 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349176+0000", 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349305+0000", 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012900699999999999 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349319+0000", 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3594999999999999e-05 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349325+0000", 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.896e-06 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349361+0000", 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6227999999999999e-05 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349495+0000", 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000133879 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.349592+0000", 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7832999999999997e-05 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.351434+0000", 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018412669999999999 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.363680+0000", 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01224657 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.363732+0000", 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1808999999999998e-05 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.363772+0000", 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0164999999999999e-05 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:56719 5.e 5:7f02f327:::benchmark_data_smithi045_43640_object56718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.481700+0000", 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.039691578999999998, 2024-04-26T12:10:30.626 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015445208, 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 56719 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481700+0000", 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481700+0000", 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481700+0000", 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481765+0000", 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4888000000000006e-05 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481769+0000", 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8799999999999999e-06 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481773+0000", 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5020000000000001e-06 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.483718+0000", 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001944989 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.483836+0000", 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011845000000000001 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.483973+0000", 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136565 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.487937+0000", 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039638099999999999 2024-04-26T12:10:30.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.497091+0000", 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0091543879999999994 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.497120+0000", 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8736000000000001e-05 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.497145+0000", 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5409e-05 2024-04-26T12:10:30.631 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:56723 5.e 5:7ef0c0c4:::benchmark_data_smithi045_43640_object56722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.481965+0000", 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.039426891999999998, 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015282277, 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:30.632 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 56723 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481965+0000", 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481965+0000", 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.633 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481964+0000", 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.481999+0000", 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5108999999999999e-05 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.482004+0000", 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9200000000000003e-06 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.482008+0000", 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.485793+0000", 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037849730000000001 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.485932+0000", 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013923700000000001 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.486074+0000", 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014170099999999999 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.489897+0000", 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0038234929999999999 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.497203+0000", 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073061669999999997 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.497226+0000", 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3088999999999999e-05 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.497247+0000", 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.637 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.638 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:30.638 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:30.638 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:30.639 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 18 16 57021 57005 197.912 150.312 0.00752755 0.00504904 2024-04-26T12:10:30.639 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:30.638+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:30.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:30.739 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:30.737+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:57513 5.c 5:32aea25b:::benchmark_data_smithi045_43640_object57512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.827207+0000", 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0027709169999999999, 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002800528, 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.832 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 57513 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827207+0000", 2024-04-26T12:10:30.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827207+0000", 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827205+0000", 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827277+0000", 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1705999999999994e-05 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827286+0000", 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7129999999999994e-06 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827292+0000", 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827330+0000", 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8569999999999998e-05 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827465+0000", 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013418600000000001 2024-04-26T12:10:30.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827618+0000", 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015380400000000001 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829693+0000", 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002074382 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57515 5.e e25/17 5:7d80b0cc:::benchmark_data_smithi045_43640_object57514:head v 25'3639, mlcod=25'3635)", 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.828976+0000", 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0010015549999999999, 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001118265, 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.828976+0000", 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.828976+0000", 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.828975+0000", 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829044+0000", 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8211000000000001e-05 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829049+0000", 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6659999999999996e-06 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829053+0000", 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.67e-06 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829456+0000", 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00040266299999999999 2024-04-26T12:10:30.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829473+0000", 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7136e-05 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57516 5.8 e25/17 5:114f43b1:::benchmark_data_smithi045_43640_object57515:head v 25'3468, mlcod=25'3466)", 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.829075+0000", 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00090242899999999995, 2024-04-26T12:10:30.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010796009999999999, 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829075+0000", 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829075+0000", 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829075+0000", 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829119+0000", 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4659000000000001e-05 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829124+0000", 2024-04-26T12:10:30.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.605e-06 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829127+0000", 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1659999999999998e-06 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829154+0000", 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7069000000000001e-05 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829166+0000", 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.188e-05 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57517 5.0 e25/17 5:0f836121:::benchmark_data_smithi045_43640_object57516:head v 25'3594, mlcod=25'3592)", 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.829192+0000", 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00078509700000000001, 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010218099999999999, 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829192+0000", 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829192+0000", 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829192+0000", 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829251+0000", 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9375e-05 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829257+0000", 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6810000000000003e-06 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829261+0000", 2024-04-26T12:10:30.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9589999999999997e-06 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829290+0000", 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9244999999999999e-05 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829303+0000", 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2738000000000001e-05 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57490 5.7 e25/17 5:e67e347e:::benchmark_data_smithi045_43640_object57489:head v 25'3678, mlcod=25'3674)", 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.817823+0000", 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.012154369, 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012451469999999999, 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.817823+0000", 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.817823+0000", 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.817822+0000", 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.817910+0000", 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7752999999999998e-05 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.817920+0000", 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5789999999999993e-06 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.817928+0000", 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7989999999999994e-06 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.818089+0000", 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016177699999999999 2024-04-26T12:10:30.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.818102+0000", 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2510999999999999e-05 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57491 5.7 e25/17 5:ef3a9b08:::benchmark_data_smithi045_43640_object57490:head v 25'3679, mlcod=25'3674)", 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.819226+0000", 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.010751584, 2024-04-26T12:10:30.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011108196000000001, 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.819226+0000", 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.819226+0000", 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.819225+0000", 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.819276+0000", 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0509e-05 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.819283+0000", 2024-04-26T12:10:30.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.819288+0000", 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.605e-06 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820944+0000", 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00165628 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820965+0000", 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1467999999999998e-05 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57492 5.7 e25/17 5:e9824c64:::benchmark_data_smithi045_43640_object57491:head v 25'3680, mlcod=25'3675)", 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.820345+0000", 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0096324129999999994, 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010050529000000001, 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820345+0000", 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820345+0000", 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820345+0000", 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820419+0000", 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4264000000000006e-05 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820427+0000", 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8779999999999998e-06 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.820430+0000", 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7220000000000001e-06 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823059+0000", 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026289030000000001 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823077+0000", 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7802999999999999e-05 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.859 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57495 5.7 e25/17 5:e3a26c98:::benchmark_data_smithi045_43640_object57494:head v 25'3681, mlcod=25'3675)", 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.821395+0000", 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0085819739999999992, 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090634510000000001, 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821395+0000", 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821395+0000", 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821395+0000", 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821448+0000", 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3449000000000003e-05 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821455+0000", 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9990000000000002e-06 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821462+0000", 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:10:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824594+0000", 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031326240000000001 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824613+0000", 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8170000000000001e-05 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57500 5.7 e25/17 5:e9d2bcc3:::benchmark_data_smithi045_43640_object57499:head v 25'3682, mlcod=25'3676)", 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.823565+0000", 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0064122179999999999, 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006957141, 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823565+0000", 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823565+0000", 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823565+0000", 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823594+0000", 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9532000000000001e-05 2024-04-26T12:10:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823603+0000", 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0680000000000003e-06 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.823610+0000", 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5529999999999998e-06 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826090+0000", 2024-04-26T12:10:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002480613 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826107+0000", 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6895e-05 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57504 5.7 e25/17 5:e4198ec4:::benchmark_data_smithi045_43640_object57503:head v 25'3683, mlcod=25'3676)", 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.824512+0000", 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0054659169999999998, 2024-04-26T12:10:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0060703440000000001, 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824512+0000", 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824512+0000", 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824511+0000", 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824541+0000", 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0151e-05 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824548+0000", 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5429999999999999e-06 2024-04-26T12:10:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.824553+0000", 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2410000000000003e-06 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827612+0000", 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030590529999999999 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827631+0000", 2024-04-26T12:10:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8292e-05 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57506 5.e e25/17 5:72125e73:::benchmark_data_smithi045_43640_object57505:head v 25'3637, mlcod=25'3635)", 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.825765+0000", 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0042125490000000003, 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048807709999999999, 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825765+0000", 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825765+0000", 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825764+0000", 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825799+0000", 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4440000000000002e-05 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825811+0000", 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2761e-05 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825818+0000", 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825853+0000", 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4860000000000002e-05 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.825871+0000", 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8567e-05 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57509 5.e e25/17 5:720f5b13:::benchmark_data_smithi045_43640_object57508:head v 25'3638, mlcod=25'3635)", 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.826770+0000", 2024-04-26T12:10:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0032071629999999999, 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039343140000000004, 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826770+0000", 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826770+0000", 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826770+0000", 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826803+0000", 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3167999999999998e-05 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826814+0000", 2024-04-26T12:10:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0732e-05 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826821+0000", 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827733+0000", 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00091243599999999998 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.827770+0000", 2024-04-26T12:10:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6418000000000003e-05 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:57512 5.7 e25/17 5:e315ef35:::benchmark_data_smithi045_43640_object57511:head v 25'3684, mlcod=25'3676)", 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.826893+0000", 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0030846440000000001, 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003877157, 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826893+0000", 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826893+0000", 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826892+0000", 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826929+0000", 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6534e-05 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826938+0000", 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6940000000000001e-06 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.826944+0000", 2024-04-26T12:10:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1940000000000003e-06 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829383+0000", 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024394 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.829400+0000", 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6871000000000002e-05 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:10:30.882 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:30.883 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:30.882+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:30.884 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:30.956 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:10:30.984 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:30.982+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:31.085 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:31.083+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:31.107 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:31.107 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:31.107 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:31.107 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:31.107 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:31.122 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:31.185 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:31.183+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:31.286 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:31.284+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:31.314 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:31.314 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:31.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:31.314 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:31.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.945154842999997, 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016256112, 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365793+0000", 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999952 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365806+0000", 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3039e-05 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365819+0000", 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3132000000000001e-05 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365834+0000", 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365953+0000", 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011895700000000001 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375316+0000", 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093566369999999992 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375394+0000", 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7732999999999996e-05 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375472+0000", 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8182999999999993e-05 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381062+0000", 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055902030000000002 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381964+0000", 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090143000000000005 2024-04-26T12:10:31.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382012+0000", 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8192999999999998e-05 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382054+0000", 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1936e-05 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.945093257000003, 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016298395, 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365858+0000", 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365864+0000", 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365873+0000", 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365882+0000", 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4989999999999994e-06 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366075+0000", 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019275499999999999 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366080+0000", 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375717+0000", 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096367499999999995 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375784+0000", 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6649000000000005e-05 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375898+0000", 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011433 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381103+0000", 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052053610000000004 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382076+0000", 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097246799999999999 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382121+0000", 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5714999999999999e-05 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382158+0000", 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6174999999999998e-05 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.326 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.945065088, 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:31.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:31.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:31.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.332 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.944992749999997, 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:31.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:31.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.944962214999997, 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016265910000000001, 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.339 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365994+0000", 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366006+0000", 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1816e-05 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366011+0000", 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368181+0000", 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021698279999999999 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368185+0000", 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4900000000000002e-06 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376058+0000", 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078721069999999997 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376139+0000", 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0958000000000007e-05 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.342 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376224+0000", 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5680000000000006e-05 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381953+0000", 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057284379999999998 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382171+0000", 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021846100000000001 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382221+0000", 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9869e-05 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382256+0000", 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5182999999999998e-05 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:31.344 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.943307107000003, 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015300935, 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367645+0000", 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367648+0000", 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.659e-06 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367657+0000", 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.367667+0000", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368391+0000", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072424000000000002 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368397+0000", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6389999999999997e-06 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377728+0000", 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093318099999999994 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377867+0000", 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013898 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382946+0000", 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050788350000000003 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:18440 5.c 5:367b11b7:::benchmark_data_smithi045_43640_object18439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.549617196, 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015638973, 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 18440 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761335+0000", 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761462+0000", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012686699999999999 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761469+0000", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1770000000000001e-06 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.761475+0000", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7479999999999999e-06 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773562+0000", 2024-04-26T12:10:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012087044999999999 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773709+0000", 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014781500000000001 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.773863+0000", 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015342099999999999 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776173+0000", 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023097959999999998 2024-04-26T12:10:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776895+0000", 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00072276100000000004 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776938+0000", 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2503999999999998e-05 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:16.776974+0000", 2024-04-26T12:10:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6337999999999997e-05 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:37890 5.a 5:586d3755:::benchmark_data_smithi045_43640_object37889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.2687192229999997, 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015306492999999999, 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 37890 2024-04-26T12:10:31.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042233+0000", 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042281+0000", 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8075000000000003e-05 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042288+0000", 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2289999999999997e-06 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.042294+0000", 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0929999999999999e-06 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044619+0000", 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023244060000000002 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044746+0000", 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012727499999999999 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.044888+0000", 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014250800000000001 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.047298+0000", 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002409797 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057491+0000", 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010193160999999999 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057519+0000", 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.758e-05 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:23.057540+0000", 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0908999999999999e-05 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45154 5.5 5:a06af483:::benchmark_data_smithi045_43640_object45153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.5251922870000003, 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016862312000000001, 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.359 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45154 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785759+0000", 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785855+0000", 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6248000000000004e-05 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785865+0000", 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2569999999999996e-06 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785872+0000", 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1579999999999999e-06 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785914+0000", 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1968000000000002e-05 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786045+0000", 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000131407 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786145+0000", 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000100283 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792782+0000", 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066362549999999998 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802539+0000", 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0097571619999999998 2024-04-26T12:10:31.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802585+0000", 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802623+0000", 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7979999999999999e-05 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.364 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45157 5.5 5:a12746f8:::benchmark_data_smithi045_43640_object45156:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.787152+0000", 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.5238003459999998, 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015548606, 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45157 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787152+0000", 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787152+0000", 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787151+0000", 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787254+0000", 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010309100000000001 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787267+0000", 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2164000000000001e-05 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.787274+0000", 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4139999999999997e-06 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.789905+0000", 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026313410000000001 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.790055+0000", 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014931100000000001 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.790196+0000", 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014171 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792823+0000", 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026264489999999999 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802631+0000", 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098082719999999998 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802670+0000", 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9193000000000002e-05 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802701+0000", 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0548e-05 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:46885 5.c 5:3064f018:::benchmark_data_smithi045_43640_object46884:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.449435+0000", 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.861517782, 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015152501000000001, 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.370 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 46885 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449435+0000", 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449435+0000", 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449434+0000", 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449514+0000", 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0054000000000003e-05 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449525+0000", 2024-04-26T12:10:31.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:10:31.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.449532+0000", 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.503e-06 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.456390+0000", 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006857546 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.456521+0000", 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013151499999999999 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.456653+0000", 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013129999999999999 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.460529+0000", 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038763909999999999 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.464512+0000", 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039826979999999998 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.464554+0000", 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1702000000000002e-05 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.464587+0000", 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3637000000000003e-05 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48065 5.e e24/17 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head v 24'3006, mlcod=24'3001)", 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.927627+0000", 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3833255659999999, 2024-04-26T12:10:31.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015599573, 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927627+0000", 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927627+0000", 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927626+0000", 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927693+0000", 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6991999999999998e-05 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927701+0000", 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3669999999999999e-06 2024-04-26T12:10:31.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.927711+0000", 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0225e-05 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.928111+0000", 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00040030600000000001 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.928130+0000", 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8923000000000002e-05 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.943189+0000", 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015058821 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.943226+0000", 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7400000000000001e-05 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.380 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48201 5.1 e24/17 5:8834a6b2:::benchmark_data_smithi045_43640_object48200:head v 24'3025, mlcod=24'3023)", 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3247138439999997, 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016625150000000002, 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:31.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986238+0000", 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986342+0000", 2024-04-26T12:10:31.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104341 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986351+0000", 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1980000000000001e-06 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986357+0000", 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.443e-06 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986391+0000", 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3862999999999997e-05 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986404+0000", 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3036e-05 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002828+0000", 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016424294999999998 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002864+0000", 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.561e-05 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48204 5.4 e24/17 5:2e474d3f:::benchmark_data_smithi045_43640_object48203:head v 24'3083, mlcod=24'3081)", 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3237351679999998, 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015725810999999999, 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987217+0000", 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987246+0000", 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8785e-05 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987253+0000", 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5660000000000001e-06 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987259+0000", 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987294+0000", 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5101000000000002e-05 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.987314+0000", 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9874e-05 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002909+0000", 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015595565 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002943+0000", 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3633000000000001e-05 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48681 5.3 5:cb5c3d78:::benchmark_data_smithi045_43640_object48680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.1205890829999996, 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017718434000000002, 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.389 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48681 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:31.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190440+0000", 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7012000000000001e-05 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190449+0000", 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190458+0000", 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190486+0000", 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8527999999999999e-05 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190600+0000", 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114209 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190680+0000", 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9470999999999999e-05 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200074+0000", 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093940699999999992 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208032+0000", 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079582980000000008 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208060+0000", 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7807e-05 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208082+0000", 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1764e-05 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.394 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48687 5.3 5:cadd13fa:::benchmark_data_smithi045_43640_object48686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.11986995, 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017046892000000001, 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48687 2024-04-26T12:10:31.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191082+0000", 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191139+0000", 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6972999999999998e-05 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191149+0000", 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0672999999999999e-05 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191156+0000", 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192066+0000", 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090978800000000002 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192160+0000", 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3597000000000005e-05 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192266+0000", 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000106258 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200102+0000", 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078359610000000007 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208089+0000", 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079876530000000008 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208112+0000", 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2662000000000001e-05 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208129+0000", 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7371e-05 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48688 5.3 5:cfd89793:::benchmark_data_smithi045_43640_object48687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.1197407679999998, 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016963124999999999, 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48688 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191211+0000", 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191271+0000", 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0461999999999998e-05 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191284+0000", 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3037000000000001e-05 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191292+0000", 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1429999999999998e-06 2024-04-26T12:10:31.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193700+0000", 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024080210000000002 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193836+0000", 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135747 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193961+0000", 2024-04-26T12:10:31.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000125084 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200129+0000", 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061672189999999998 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208138+0000", 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0080092600000000007 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208159+0000", 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0834000000000001e-05 2024-04-26T12:10:31.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208175+0000", 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6242000000000001e-05 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48685 5.b e24/17 5:deb77a5f:::benchmark_data_smithi045_43640_object48684:head v 24'2981, mlcod=24'2979)", 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.192059+0000", 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.1188930739999998, 2024-04-26T12:10:31.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016143477999999999, 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192059+0000", 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192059+0000", 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192059+0000", 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192090+0000", 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0456000000000001e-05 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192096+0000", 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6080000000000001e-06 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192102+0000", 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0739999999999998e-06 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.194759+0000", 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026564100000000001 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.194782+0000", 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2931000000000001e-05 2024-04-26T12:10:31.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208177+0000", 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013395585 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208203+0000", 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5758e-05 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.410 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:57462 5.a 5:58ae117f:::benchmark_data_smithi045_43640_object57461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.50726738800000004, 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017784415000000001, 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 57462 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803684+0000", 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803792+0000", 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108249 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803805+0000", 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2941e-05 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803815+0000", 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810187+0000", 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063728329999999996 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810321+0000", 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000133287 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810470+0000", 2024-04-26T12:10:31.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014878800000000001 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.815019+0000", 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045490419999999997 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821390+0000", 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063716229999999999 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821434+0000", 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4206000000000003e-05 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821470+0000", 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5122e-05 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:58405 5.6 5:6ac4fbba:::benchmark_data_smithi045_43640_object58404:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:31.216225+0000", 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.094727591999999999, 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015190912000000001, 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 58405 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.216225+0000", 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.216225+0000", 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.216224+0000", 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.216295+0000", 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0740000000000004e-05 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.216304+0000", 2024-04-26T12:10:31.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1209999999999996e-06 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.216311+0000", 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8730000000000001e-06 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.218217+0000", 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019058250000000001 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.218346+0000", 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012964899999999999 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.218487+0000", 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014039799999999999 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.222860+0000", 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043728359999999997 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.231335+0000", 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084755209999999997 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.231379+0000", 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3420000000000001e-05 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.231416+0000", 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7181999999999997e-05 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.425 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:31.426 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:31.426 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:31.427 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:31.425+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:31.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:31.528 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:31.527+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59241 5.2 5:4ceba37b:::benchmark_data_smithi045_43640_object59240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.592810+0000", 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0052797019999999998, 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053041750000000004, 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:31.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59241 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592810+0000", 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592810+0000", 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592809+0000", 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592894+0000", 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4897999999999999e-05 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592908+0000", 2024-04-26T12:10:31.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4174e-05 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592918+0000", 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0438999999999999e-05 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592951+0000", 2024-04-26T12:10:31.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2972000000000002e-05 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593049+0000", 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7436999999999996e-05 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593177+0000", 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012791300000000001 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:31.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.596955+0000", 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037780790000000002 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59246 5.2 5:4d89a670:::benchmark_data_smithi045_43640_object59245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0050485089999999996, 2024-04-26T12:10:31.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051304499999999999, 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59246 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:31.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593204+0000", 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016378899999999999 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593213+0000", 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4700000000000002e-06 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593220+0000", 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7079999999999997e-06 2024-04-26T12:10:31.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.595417+0000", 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021963960000000002 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.595543+0000", 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623300000000001 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.595646+0000", 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010275100000000001 2024-04-26T12:10:31.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.597219+0000", 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015729330000000001 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59250 5.1 5:834dfbc4:::benchmark_data_smithi045_43640_object59249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.593235+0000", 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.004855112, 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049863399999999997, 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:31.609 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59250 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593235+0000", 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593235+0000", 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593234+0000", 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593351+0000", 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116487 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593360+0000", 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4839999999999993e-06 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593366+0000", 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.947e-06 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593394+0000", 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8424000000000001e-05 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593530+0000", 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013587300000000001 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593632+0000", 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101264 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.596019+0000", 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023871000000000001 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:31.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59257 5.7 5:ef62e2e2:::benchmark_data_smithi045_43640_object59256:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.598034+0000", 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5797000000000001e-05, 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024840799999999998, 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59257 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.614 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598034+0000", 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598034+0000", 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598033+0000", 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598085+0000", 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1909000000000001e-05 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598096+0000", 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0959e-05 2024-04-26T12:10:31.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598105+0000", 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5829999999999996e-06 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598138+0000", 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2706000000000002e-05 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.598230+0000", 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1373999999999996e-05 2024-04-26T12:10:31.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:31.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:31.618 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-26T12:10:31.618 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 4 2024-04-26T12:10:31.618 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:31.619 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 19 16 59270 59254 194.892 140.562 0.00374207 0.0051271 2024-04-26T12:10:31.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:31.629 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:31.627+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:31.730 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:31.728+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:31.831 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:31.829+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:31.835 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:31.836 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:31.836 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-26T12:10:31.836 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-26T12:10:31.836 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:31.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:31.932 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:31.930+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:32.033 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:32.032+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:32.037 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33759 5.1 5:84a1f1a6:::benchmark_data_smithi045_43640_object33758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.417757845000001, 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016968066, 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33759 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616495+0000", 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5689999999999998e-05 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616500+0000", 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6540000000000004e-06 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616504+0000", 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622769+0000", 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062649180000000004 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622858+0000", 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9061000000000007e-05 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622968+0000", 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109968 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.626085+0000", 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031169380000000001 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633354+0000", 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007269195 2024-04-26T12:10:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633393+0000", 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-05 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633417+0000", 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4714000000000001e-05 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33877 5.f 5:f51a14f1:::benchmark_data_smithi045_43640_object33876:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.374316377, 2024-04-26T12:10:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018870086000000001, 2024-04-26T12:10:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33877 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659890+0000", 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660025+0000", 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013460999999999999 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660034+0000", 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5610000000000004e-06 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660042+0000", 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6539999999999999e-06 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662113+0000", 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020712669999999999 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662224+0000", 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111047 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662342+0000", 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117724 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674933+0000", 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012590874 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678698+0000", 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003764744 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678727+0000", 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9731999999999999e-05 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678761+0000", 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3689999999999998e-05 2024-04-26T12:10:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33879 5.f 5:fe04d5bf:::benchmark_data_smithi045_43640_object33878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.374155515, 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018825173000000001, 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33879 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660051+0000", 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660142+0000", 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1260000000000004e-05 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660165+0000", 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2415000000000001e-05 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660173+0000", 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8939999999999993e-06 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664571+0000", 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043981319999999999 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664692+0000", 2024-04-26T12:10:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120973 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664834+0000", 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014225699999999999 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675098+0000", 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01026411 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678827+0000", 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037293489999999999 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678850+0000", 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2881e-05 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678877+0000", 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33880 5.7 5:ed20740e:::benchmark_data_smithi045_43640_object33879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.3740267, 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018640117000000001, 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33880 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660180+0000", 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660214+0000", 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3918999999999998e-05 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660223+0000", 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4720000000000001e-06 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660229+0000", 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.105e-06 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663597+0000", 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033676520000000001 2024-04-26T12:10:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663724+0000", 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012658400000000001 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663845+0000", 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121259 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674912+0000", 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011067359000000001 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678766+0000", 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038536619999999999 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678792+0000", 2024-04-26T12:10:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6057000000000001e-05 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678821+0000", 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8759e-05 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33881 5.7 5:e79e3d8f:::benchmark_data_smithi045_43640_object33880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.373969632, 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02032948, 2024-04-26T12:10:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33881 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660237+0000", 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660285+0000", 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7581999999999999e-05 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660295+0000", 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0343000000000001e-05 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660302+0000", 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8959999999999997e-06 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675086+0000", 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014784357 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675240+0000", 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015400599999999999 2024-04-26T12:10:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675391+0000", 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015063500000000001 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678883+0000", 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003492242 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680504+0000", 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001621209 2024-04-26T12:10:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680544+0000", 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9360000000000003e-05 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680567+0000", 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3405999999999999e-05 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33890 5.7 5:eb376974:::benchmark_data_smithi045_43640_object33889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.370364768, 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017030601999999999, 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33890 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663889+0000", 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7574999999999998e-05 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663900+0000", 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0547000000000001e-05 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663907+0000", 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676758+0000", 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012851234 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676858+0000", 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9437000000000004e-05 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676966+0000", 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678886+0000", 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019195010000000001 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680830+0000", 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001943857 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680854+0000", 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4550999999999999e-05 2024-04-26T12:10:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680873+0000", 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8879999999999999e-05 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33895 5.7 5:ed801b04:::benchmark_data_smithi045_43640_object33894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.666330+0000", 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.367877521, 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016523388999999999, 2024-04-26T12:10:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33895 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666330+0000", 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666330+0000", 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666329+0000", 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666460+0000", 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013093299999999999 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666469+0000", 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9660000000000002e-06 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.666476+0000", 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.677845+0000", 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01136853 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.677933+0000", 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8588e-05 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678017+0000", 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3982999999999999e-05 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.679222+0000", 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012045479999999999 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.682787+0000", 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035649449999999999 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.682817+0000", 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9694999999999999e-05 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.682853+0000", 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6477000000000003e-05 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:37840 5.1 5:81ea6f93:::benchmark_data_smithi045_43640_object37839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.0104983379999997, 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016557145999999998, 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37840 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023708+0000", 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023816+0000", 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010798600000000001 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023823+0000", 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3329999999999999e-06 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023829+0000", 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5929999999999996e-06 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024790+0000", 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096075000000000002 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024861+0000", 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0808000000000004e-05 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024934+0000", 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3213999999999994e-05 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.027949+0000", 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030152529999999999 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040172+0000", 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012223194 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040211+0000", 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8624999999999997e-05 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040266+0000", 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5133999999999998e-05 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:48201 5.1 5:8834a6b2:::benchmark_data_smithi045_43640_object48200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.0483310550000002, 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017211021, 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 48201 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985875+0000", 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985974+0000", 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8887000000000004e-05 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985985+0000", 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0716999999999999e-05 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985992+0000", 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0099999999999998e-06 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986021+0000", 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9193999999999999e-05 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986114+0000", 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2709999999999998e-05 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986198+0000", 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3875999999999995e-05 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.991350+0000", 2024-04-26T12:10:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005152607 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003021+0000", 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011671340000000001 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003053+0000", 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1149999999999998e-05 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003087+0000", 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4533000000000003e-05 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:49307 5.2 5:4de5d634:::benchmark_data_smithi045_43640_object49306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.443284+0000", 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.590923364, 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016550118999999999, 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 49307 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443284+0000", 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443284+0000", 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443283+0000", 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443367+0000", 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3521000000000002e-05 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443380+0000", 2024-04-26T12:10:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3297e-05 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443387+0000", 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3919999999999997e-06 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.443965+0000", 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057776099999999999 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.444084+0000", 2024-04-26T12:10:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118844 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.444215+0000", 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131521 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.452879+0000", 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086637299999999997 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459768+0000", 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068892240000000002 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459800+0000", 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1537e-05 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.459834+0000", 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4093e-05 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50361 5.7 5:e5f8ec2d:::benchmark_data_smithi045_43640_object50360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.846194+0000", 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1880136849999996, 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016520201000000002, 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50361 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846194+0000", 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846194+0000", 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846193+0000", 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846253+0000", 2024-04-26T12:10:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9567000000000001e-05 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846259+0000", 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6839999999999999e-06 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.846264+0000", 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.011e-06 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.851058+0000", 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047939310000000004 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.851153+0000", 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4376000000000006e-05 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.851258+0000", 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105715 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.858299+0000", 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070404650000000001 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862635+0000", 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043359820000000004 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862677+0000", 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2382000000000002e-05 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862714+0000", 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6547000000000001e-05 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50366 5.7 5:ee434614:::benchmark_data_smithi045_43640_object50365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.185191841, 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016095155999999999, 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50366 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849015+0000", 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849072+0000", 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7108000000000003e-05 2024-04-26T12:10:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849082+0000", 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0550000000000001e-05 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.849090+0000", 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8900000000000007e-06 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.852599+0000", 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003508621 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.852721+0000", 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012251100000000001 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.852847+0000", 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012527999999999999 2024-04-26T12:10:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.858369+0000", 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055228250000000003 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865042+0000", 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066726019999999997 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865073+0000", 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1047000000000003e-05 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.865111+0000", 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7412e-05 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50399 5.7 5:ec508f68:::benchmark_data_smithi045_43640_object50398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1715754, 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019023064999999999, 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50399 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862631+0000", 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862738+0000", 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106563 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862758+0000", 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0044999999999999e-05 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862773+0000", 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.868879+0000", 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061068269999999996 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.869013+0000", 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013344400000000001 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.869145+0000", 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013240300000000001 2024-04-26T12:10:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.876895+0000", 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077496470000000001 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881560+0000", 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046651339999999996 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881613+0000", 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3415999999999998e-05 2024-04-26T12:10:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881655+0000", 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1389e-05 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50402 5.7 5:e2d53af1:::benchmark_data_smithi045_43640_object50401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1695531260000003, 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017115340999999999, 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50402 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864653+0000", 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864724+0000", 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0258000000000004e-05 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864732+0000", 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6270000000000006e-06 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864738+0000", 2024-04-26T12:10:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7420000000000003e-06 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.870921+0000", 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006182786 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.871111+0000", 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019038200000000001 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.871288+0000", 2024-04-26T12:10:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017691699999999999 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.876980+0000", 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005691537 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881703+0000", 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047232660000000003 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881744+0000", 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1010999999999997e-05 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881769+0000", 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5531999999999999e-05 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59241 5.2 5:4ceba37b:::benchmark_data_smithi045_43640_object59240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.592810+0000", 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.44139713000000003, 2024-04-26T12:10:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016414610999999999, 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59241 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592810+0000", 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592810+0000", 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592809+0000", 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592894+0000", 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4897999999999999e-05 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592908+0000", 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4174e-05 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592918+0000", 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0438999999999999e-05 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.592951+0000", 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2972000000000002e-05 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593049+0000", 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7436999999999996e-05 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593177+0000", 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012791300000000001 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.596955+0000", 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037780790000000002 2024-04-26T12:10:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.609126+0000", 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012171885 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.609182+0000", 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5600999999999998e-05 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.609225+0000", 2024-04-26T12:10:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2605999999999998e-05 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59246 5.2 5:4d89a670:::benchmark_data_smithi045_43640_object59245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.44116593700000001, 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016273117, 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59246 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593041+0000", 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593204+0000", 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016378899999999999 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593213+0000", 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4700000000000002e-06 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.593220+0000", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7079999999999997e-06 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.595417+0000", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021963960000000002 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.595543+0000", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623300000000001 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.595646+0000", 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010275100000000001 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.597219+0000", 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015729330000000001 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.609265+0000", 2024-04-26T12:10:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012045821 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.609292+0000", 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7753999999999999e-05 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.609314+0000", 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2039e-05 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59443 5.7 5:ec0e963c:::benchmark_data_smithi045_43640_object59442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35898091799999998, 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019184587999999999, 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59443 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675342+0000", 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116469 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675355+0000", 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2839e-05 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675361+0000", 2024-04-26T12:10:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.835e-06 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675397+0000", 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6177000000000003e-05 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675533+0000", 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013585800000000001 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675679+0000", 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014642100000000001 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679131+0000", 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034519030000000001 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694316+0000", 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015185269 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694371+0000", 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4203000000000003e-05 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694411+0000", 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0367999999999997e-05 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59449 5.7 5:eb5c443a:::benchmark_data_smithi045_43640_object59448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.676823+0000", 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35738398399999999, 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017671829999999999, 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59449 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676823+0000", 2024-04-26T12:10:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676823+0000", 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676822+0000", 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676901+0000", 2024-04-26T12:10:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8282999999999996e-05 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676909+0000", 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1189999999999997e-06 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676916+0000", 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.097e-06 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679153+0000", 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022371819999999999 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679311+0000", 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015810100000000001 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679465+0000", 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015371199999999999 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.684852+0000", 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053871079999999998 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694420+0000", 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095677669999999996 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694462+0000", 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1909999999999997e-05 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694495+0000", 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3402000000000003e-05 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59452 5.7 5:e35c17ad:::benchmark_data_smithi045_43640_object59451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.677922+0000", 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35628538500000001, 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016662412000000001, 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59452 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.677922+0000", 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.677922+0000", 2024-04-26T12:10:32.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.677921+0000", 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.678015+0000", 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4618999999999997e-05 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.678027+0000", 2024-04-26T12:10:32.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2268e-05 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.678036+0000", 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1829999999999994e-06 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.682212+0000", 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041768090000000001 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.682337+0000", 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012420199999999999 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.682447+0000", 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109887 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.684992+0000", 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025453659999999999 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694503+0000", 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095114819999999999 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694551+0000", 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694584+0000", 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3087999999999999e-05 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.150 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59459 5.7 5:e9ef5a59:::benchmark_data_smithi045_43640_object59458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.680653+0000", 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35355372600000001, 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016450050000000001, 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59459 2024-04-26T12:10:32.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.680653+0000", 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.680653+0000", 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.680653+0000", 2024-04-26T12:10:32.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.680747+0000", 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3972000000000001e-05 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.680753+0000", 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3810000000000004e-06 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.680758+0000", 2024-04-26T12:10:32.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3440000000000003e-06 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.687974+0000", 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072168229999999998 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.688086+0000", 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111525 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:32.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.688190+0000", 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010408699999999999 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694766+0000", 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065755379999999997 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.697003+0000", 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022370070000000001 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:32.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.697058+0000", 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5333e-05 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.697104+0000", 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5688e-05 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:32.156 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:32.158 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:32.155+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:32.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:32.258 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:32.257+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:32.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:60962 5.d 5:b8957721:::benchmark_data_smithi045_43640_object60961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:32.326938+0000", 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0043919859999999996, 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044138759999999997, 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:32.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 60962 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.326938+0000", 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.326938+0000", 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.326937+0000", 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327064+0000", 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012626599999999999 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327075+0000", 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:32.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327082+0000", 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1679999999999998e-06 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327125+0000", 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2522999999999999e-05 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327268+0000", 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014324800000000001 2024-04-26T12:10:32.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327411+0000", 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014260299999999999 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.330346+0000", 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029351550000000001 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.336 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:60968 5.d 5:b70ca36b:::benchmark_data_smithi045_43640_object60967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:32.327499+0000", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0038319750000000001, 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039085639999999998, 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 60968 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327499+0000", 2024-04-26T12:10:32.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327499+0000", 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327498+0000", 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:32.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327579+0000", 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1618000000000004e-05 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327589+0000", 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8060000000000006e-06 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.327596+0000", 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7630000000000003e-06 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:32.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.329017+0000", 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014205299999999999 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.329109+0000", 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2448999999999995e-05 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.329210+0000", 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010135400000000001 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:32.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.330583+0000", 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001372947 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:60972 5.b 5:d46f7276:::benchmark_data_smithi045_43640_object60971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:32.331279+0000", 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.1867999999999999e-05, 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018021500000000001, 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:32.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 60972 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331279+0000", 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331279+0000", 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331278+0000", 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331362+0000", 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4707000000000001e-05 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331371+0000", 2024-04-26T12:10:32.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8559999999999996e-06 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331376+0000", 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331417+0000", 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1054999999999999e-05 2024-04-26T12:10:32.344 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:60973 5.d 5:bc04a621:::benchmark_data_smithi045_43640_object60972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:32.331384+0000", 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9999461, 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011358600000000001, 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.345 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 60973 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331384+0000", 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331384+0000", 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:32.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331384+0000", 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331419+0000", 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4947000000000003e-05 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331426+0000", 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9879999999999998e-06 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331431+0000", 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4009999999999996e-06 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331460+0000", 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9088e-05 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:60974 5.e 5.1937eb9e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:32.331439+0000", 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998913, 2024-04-26T12:10:32.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4228000000000007e-05, 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 60974 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331439+0000", 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331439+0000", 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331439+0000", 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:32.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331475+0000", 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5856999999999999e-05 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331484+0000", 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331489+0000", 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2310000000000004e-06 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:32.331530+0000", 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1662999999999997e-05 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 5 2024-04-26T12:10:32.352 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:32.353 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:32.359 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:32.358+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:32.460 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:32.458+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:32.499 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:32.520 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:32.521 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:32.521 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:32.535 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:32.542 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:32.543 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:32.543 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:32.544 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:32.576 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:32.574+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:32.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:2024-04-26T12:10:32.605012+0000 min lat: 0.00110881 max lat: 0.0666514 avg lat: 0.00519156 2024-04-26T12:10:32.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T12:10:32.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 20 16 61619 61603 192.488 146.812 0.0045853 0.00519156 2024-04-26T12:10:32.662 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:32.661+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:32.759 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:32.760 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:32.763 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:32.761+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:32.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:32.875 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:32.873+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:32.964 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:32.962+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:32.967 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:32.967 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:32.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:10:32.982 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:33.065 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:33.065+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:33.167 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:33.166+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:33.213 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:33.214 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:33.228 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:33.271 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:33.269+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:33.368 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:33.368+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:33.417 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:33.417 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:33.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:33.469 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:33.467+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:33.512 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:10:33.512 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:33.512 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:10:33.512 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:10:33.512 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:10:33.513 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:10:33.570 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:33.570+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:33.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 21 16 63850 63834 189.961 139.438 0.0042941 0.00526007 2024-04-26T12:10:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:33.616 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:33.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:33.672 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:33.671+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:33.679 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "" 2024-04-26T12:10:33.680 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:33.772 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:33.770+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:33.846 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:33.846 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:33.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:33.873 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:33.871+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:10:33.974 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:33.972+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:34.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:34.088 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:34.086+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:34.175 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:34.173+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:34.215 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:34.215 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:34.229 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:34.313 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:34.311+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:34.378 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:34.376+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:34.440 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:34.440 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:34.455 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:34.498 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:34.494+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:34.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:34.579 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:34.577+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:34.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 22 16 66090 66074 187.689 140 0.00528031 0.00532419 2024-04-26T12:10:34.671 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:34.671 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:34.681 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:34.679+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:34.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:34.731 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:34.753 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:34.774 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:34.776 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:34.776 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:34.776 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:34.781 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:34.780+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66646 5.b e27/17 5:d264e198:::benchmark_data_smithi045_43640_object66645:head v 27'4091, mlcod=27'4089)", 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.868874+0000", 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0010044990000000001, 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010328290000000001, 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868874+0000", 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868874+0000", 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868873+0000", 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868933+0000", 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9836000000000001e-05 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868940+0000", 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4970000000000004e-06 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868945+0000", 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8019999999999999e-06 2024-04-26T12:10:34.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868975+0000", 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9926000000000001e-05 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868993+0000", 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8043e-05 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66648 5.e e27/17 5:70674d38:::benchmark_data_smithi045_43640_object66647:head v 27'4206, mlcod=27'4201)", 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.869458+0000", 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000419944, 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00051340800000000003, 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869458+0000", 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869458+0000", 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869457+0000", 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869540+0000", 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.25e-05 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869551+0000", 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1114000000000001e-05 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869557+0000", 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869809+0000", 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00025133000000000002 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869825+0000", 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6158999999999999e-05 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:66631 5.a 5:5c38ea12:::benchmark_data_smithi045_43640_object66630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.860726+0000", 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0091522670000000004, 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093120570000000003, 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:34.879 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 66631 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.860726+0000", 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.860726+0000", 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.860725+0000", 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.860792+0000", 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7138999999999995e-05 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.860802+0000", 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8290000000000003e-06 2024-04-26T12:10:34.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.860826+0000", 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4389e-05 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862431+0000", 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016048939999999999 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862559+0000", 2024-04-26T12:10:34.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012724000000000001 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862704+0000", 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145618 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866688+0000", 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039842569999999997 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66629 5.e e27/17 5:7e3ff612:::benchmark_data_smithi045_43640_object66628:head v 27'4204, mlcod=27'4200)", 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.862782+0000", 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.007096308, 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0073357479999999996, 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862782+0000", 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862782+0000", 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862781+0000", 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862812+0000", 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0877999999999998e-05 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862823+0000", 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0679000000000001e-05 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862829+0000", 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2430000000000002e-06 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862881+0000", 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2377999999999999e-05 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862912+0000", 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1118999999999998e-05 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:66636 5.a 5:54f936af:::benchmark_data_smithi045_43640_object66635:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.862919+0000", 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0069588139999999998, 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0072623280000000002, 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.887 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 66636 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862919+0000", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862919+0000", 2024-04-26T12:10:34.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.862918+0000", 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.863049+0000", 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013062600000000001 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.863061+0000", 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1718e-05 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.863069+0000", 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6600000000000001e-06 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864559+0000", 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001489146 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864647+0000", 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8461999999999994e-05 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864735+0000", 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7837999999999995e-05 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866720+0000", 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019846920000000001 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66638 5.2 e27/17 5:4a8e8f3d:::benchmark_data_smithi045_43640_object66637:head v 27'4149, mlcod=27'4147)", 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.864245+0000", 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0056333540000000001, 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0060154329999999997, 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864245+0000", 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864245+0000", 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864244+0000", 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864359+0000", 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114605 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864366+0000", 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9750000000000001e-06 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864370+0000", 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6210000000000003e-06 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864466+0000", 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6100999999999994e-05 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864483+0000", 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7020999999999998e-05 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66630 5.e e27/17 5:76c1f2a4:::benchmark_data_smithi045_43640_object66629:head v 27'4205, mlcod=27'4200)", 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.864280+0000", 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0055982460000000003, 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0060383859999999998, 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.895 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864280+0000", 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864280+0000", 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864279+0000", 2024-04-26T12:10:34.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864377+0000", 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8115999999999994e-05 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864386+0000", 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8610000000000004e-06 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.864393+0000", 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4930000000000003e-06 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865144+0000", 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000751886 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865170+0000", 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:10:34.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66637 5.7 e27/17 5:e1827bec:::benchmark_data_smithi045_43640_object66636:head v 27'4283, mlcod=27'4280)", 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.865219+0000", 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0046593299999999997, 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005159449, 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865219+0000", 2024-04-26T12:10:34.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865219+0000", 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865218+0000", 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865248+0000", 2024-04-26T12:10:34.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0154e-05 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865255+0000", 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.08e-06 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865261+0000", 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5010000000000004e-06 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865293+0000", 2024-04-26T12:10:34.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1587000000000001e-05 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865317+0000", 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4715999999999998e-05 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:66641 5.6 5:6acbda1e:::benchmark_data_smithi045_43640_object66640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.865561+0000", 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004316833, 2024-04-26T12:10:34.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004878968, 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 66641 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865561+0000", 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865561+0000", 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865560+0000", 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:34.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865648+0000", 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8012999999999999e-05 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865660+0000", 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1377e-05 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865668+0000", 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3100000000000001e-06 2024-04-26T12:10:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868965+0000", 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0032965249999999998 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869081+0000", 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000116909 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869221+0000", 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014000699999999999 2024-04-26T12:10:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:66642 5.a 5:5c4c9591:::benchmark_data_smithi045_43640_object66641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.865677+0000", 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0042014130000000002, 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048427799999999997, 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:34.908 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 66642 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865677+0000", 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865677+0000", 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865676+0000", 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865755+0000", 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8740999999999997e-05 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865762+0000", 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1729999999999998e-06 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.865767+0000", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1549999999999998e-06 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866750+0000", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00098259200000000001 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866883+0000", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013344 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:34.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867024+0000", 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014095500000000001 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869038+0000", 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002013908 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66639 5.2 e27/17 5:40d9559f:::benchmark_data_smithi045_43640_object66638:head v 27'4150, mlcod=27'4147)", 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.866051+0000", 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003826767, 2024-04-26T12:10:34.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004551294, 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866051+0000", 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866051+0000", 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866051+0000", 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866120+0000", 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9461999999999993e-05 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866126+0000", 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5199999999999997e-06 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866130+0000", 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.065e-06 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866665+0000", 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00053503600000000002 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866681+0000", 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5849e-05 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.915 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:66644 5.c 5:387d4c71:::benchmark_data_smithi045_43640_object66643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.866758+0000", 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031202000000000001, 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039141369999999998, 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 66644 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.916 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866758+0000", 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866758+0000", 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866757+0000", 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:34.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866815+0000", 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7778000000000001e-05 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866826+0000", 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0944999999999999e-05 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866831+0000", 2024-04-26T12:10:34.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3410000000000002e-06 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866864+0000", 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2515000000000003e-05 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.866950+0000", 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6161000000000004e-05 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:34.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867082+0000", 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000132321 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66645 5.7 e27/17 5:ea0faa18:::benchmark_data_smithi045_43640_object66644:head v 27'4284, mlcod=27'4280)", 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.867176+0000", 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0027022449999999998, 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035830369999999999, 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.920 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867176+0000", 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867176+0000", 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867175+0000", 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867232+0000", 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6638000000000002e-05 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867242+0000", 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9890000000000004e-06 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867248+0000", 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5289999999999997e-06 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867293+0000", 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5101000000000001e-05 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867323+0000", 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9349999999999999e-05 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:66640 5.2 e27/17 5:4896f7ee:::benchmark_data_smithi045_43640_object66639:head v 27'4151, mlcod=27'4147)", 2024-04-26T12:10:34.923 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.867725+0000", 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0021528099999999998, 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030781459999999999, 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867725+0000", 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867725+0000", 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867725+0000", 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867777+0000", 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2326e-05 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867786+0000", 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9940000000000006e-06 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.867791+0000", 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.395e-06 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869030+0000", 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012388379999999999 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.869049+0000", 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8921000000000001e-05 2024-04-26T12:10:34.926 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:66647 5.3 5:cbce8407:::benchmark_data_smithi045_43640_object66646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:34.868599+0000", 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0012791020000000001, 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022657060000000001, 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 66647 2024-04-26T12:10:34.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868599+0000", 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868599+0000", 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868598+0000", 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:34.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868659+0000", 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0942e-05 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868667+0000", 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7470000000000005e-06 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868672+0000", 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:10:34.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868706+0000", 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3671999999999999e-05 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868798+0000", 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1609999999999999e-05 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:34.868931+0000", 2024-04-26T12:10:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013298499999999999 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 15 2024-04-26T12:10:34.931 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:34.933 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:34.933 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:34.930+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.033 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:35.031+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:35.135 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.132+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.159 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:35.160 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:35.160 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:35.160 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:35.160 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:35.176 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:35.262 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.260+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.336 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.334+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.397 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 46.028871725000002, 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016256112, 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.398 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365798+0000", 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365793+0000", 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999952 2024-04-26T12:10:35.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365806+0000", 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3039e-05 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365819+0000", 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3132000000000001e-05 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365834+0000", 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:10:35.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365953+0000", 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011895700000000001 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375316+0000", 2024-04-26T12:10:35.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093566369999999992 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375394+0000", 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7732999999999996e-05 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375472+0000", 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8182999999999993e-05 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381062+0000", 2024-04-26T12:10:35.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055902030000000002 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381964+0000", 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090143000000000005 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382012+0000", 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8192999999999998e-05 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382054+0000", 2024-04-26T12:10:35.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1936e-05 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 46.028810139000001, 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016298395, 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365859+0000", 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365858+0000", 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365864+0000", 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365873+0000", 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365882+0000", 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4989999999999994e-06 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366075+0000", 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019275499999999999 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366080+0000", 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375717+0000", 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0096367499999999995 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375784+0000", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6649000000000005e-05 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.375898+0000", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011433 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381103+0000", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052053610000000004 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382076+0000", 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00097246799999999999 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382121+0000", 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5714999999999999e-05 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382158+0000", 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6174999999999998e-05 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 46.028781969999997, 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:35.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:35.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:35.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:35.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 46.028709632000002, 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:35.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:35.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 46.028679097000001, 2024-04-26T12:10:35.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016265910000000001, 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365990+0000", 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365994+0000", 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366006+0000", 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1816e-05 2024-04-26T12:10:35.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366011+0000", 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368181+0000", 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021698279999999999 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.368185+0000", 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4900000000000002e-06 2024-04-26T12:10:35.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376058+0000", 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078721069999999997 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376139+0000", 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0958000000000007e-05 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.376224+0000", 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5680000000000006e-05 2024-04-26T12:10:35.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381953+0000", 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057284379999999998 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382171+0000", 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021846100000000001 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382221+0000", 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9869e-05 2024-04-26T12:10:35.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382256+0000", 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5182999999999998e-05 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45154 5.5 5:a06af483:::benchmark_data_smithi045_43640_object45153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6089091690000004, 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016862312000000001, 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.427 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45154 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:35.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785759+0000", 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785855+0000", 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6248000000000004e-05 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785865+0000", 2024-04-26T12:10:35.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2569999999999996e-06 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785872+0000", 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1579999999999999e-06 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785914+0000", 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1968000000000002e-05 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786045+0000", 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000131407 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786145+0000", 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000100283 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792782+0000", 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066362549999999998 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802539+0000", 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0097571619999999998 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802585+0000", 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802623+0000", 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7979999999999999e-05 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:48201 5.1 e24/17 5:8834a6b2:::benchmark_data_smithi045_43640_object48200:head v 24'3025, mlcod=24'3023)", 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.4084307260000006, 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016625150000000002, 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986239+0000", 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986238+0000", 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986342+0000", 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104341 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986351+0000", 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1980000000000001e-06 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986357+0000", 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.443e-06 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986391+0000", 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3862999999999997e-05 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:26.986404+0000", 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3036e-05 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002828+0000", 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016424294999999998 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.002864+0000", 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.561e-05 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48681 5.3 5:cb5c3d78:::benchmark_data_smithi045_43640_object48680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.2043059649999996, 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017718434000000002, 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48681 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190440+0000", 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7012000000000001e-05 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190449+0000", 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190458+0000", 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190486+0000", 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8527999999999999e-05 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190600+0000", 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114209 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190680+0000", 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9470999999999999e-05 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200074+0000", 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093940699999999992 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208032+0000", 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079582980000000008 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208060+0000", 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7807e-05 2024-04-26T12:10:35.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208082+0000", 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1764e-05 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48687 5.3 5:cadd13fa:::benchmark_data_smithi045_43640_object48686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.2035868319999992, 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017046892000000001, 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.442 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48687 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191082+0000", 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191139+0000", 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6972999999999998e-05 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191149+0000", 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0672999999999999e-05 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191156+0000", 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192066+0000", 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090978800000000002 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192160+0000", 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3597000000000005e-05 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192266+0000", 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000106258 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200102+0000", 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078359610000000007 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208089+0000", 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079876530000000008 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208112+0000", 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2662000000000001e-05 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208129+0000", 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7371e-05 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48688 5.3 5:cfd89793:::benchmark_data_smithi045_43640_object48687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.2034576500000007, 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016963124999999999, 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48688 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191211+0000", 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191271+0000", 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0461999999999998e-05 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191284+0000", 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3037000000000001e-05 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191292+0000", 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1429999999999998e-06 2024-04-26T12:10:35.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193700+0000", 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024080210000000002 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193836+0000", 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135747 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193961+0000", 2024-04-26T12:10:35.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000125084 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200129+0000", 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061672189999999998 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208138+0000", 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0080092600000000007 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208159+0000", 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0834000000000001e-05 2024-04-26T12:10:35.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208175+0000", 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6242000000000001e-05 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:57462 5.a 5:58ae117f:::benchmark_data_smithi045_43640_object57461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5909842699999999, 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017784415000000001, 2024-04-26T12:10:35.453 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 57462 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803684+0000", 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803792+0000", 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108249 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803805+0000", 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2941e-05 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803815+0000", 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810187+0000", 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063728329999999996 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810321+0000", 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000133287 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810470+0000", 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014878800000000001 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.815019+0000", 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045490419999999997 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821390+0000", 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063716229999999999 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821434+0000", 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4206000000000003e-05 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821470+0000", 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5122e-05 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:59102 5.e e26/17 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head v 26'3740, mlcod=26'3735)", 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.8645748630000001, 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017035195, 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530168+0000", 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4119e-05 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530178+0000", 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530185+0000", 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3999999999999997e-06 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.531272+0000", 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010875049999999999 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.531290+0000", 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7972999999999999e-05 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.547109+0000", 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015818279000000001 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.547130+0000", 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.107e-05 2024-04-26T12:10:35.462 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:61241 5.c 5:3da9b6ff:::benchmark_data_smithi045_43640_object61240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:32.439126+0000", 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.9555435870000002, 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016207256, 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 61241 2024-04-26T12:10:35.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.439126+0000", 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.439126+0000", 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.439125+0000", 2024-04-26T12:10:35.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.439196+0000", 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0185000000000006e-05 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.439201+0000", 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8220000000000003e-06 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.439205+0000", 2024-04-26T12:10:35.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7629999999999998e-06 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.444003+0000", 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0047976879999999996 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.444092+0000", 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8675000000000001e-05 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.444188+0000", 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6799000000000006e-05 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.450147+0000", 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005958667 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.455261+0000", 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051142469999999997 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.455302+0000", 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0295e-05 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.455333+0000", 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1477999999999999e-05 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:61244 5.c 5:3f3e7096:::benchmark_data_smithi045_43640_object61243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:32.441200+0000", 2024-04-26T12:10:35.468 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.9534689209999998, 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016271065000000001, 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 61244 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.441200+0000", 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.441200+0000", 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.441200+0000", 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.441277+0000", 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7186000000000003e-05 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.441287+0000", 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5400000000000001e-06 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.441295+0000", 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1470000000000001e-06 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.450329+0000", 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090347689999999998 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.450456+0000", 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012705 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.450605+0000", 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000148293 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.455466+0000", 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048610779999999996 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.457388+0000", 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019218620000000001 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.457438+0000", 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0553000000000002e-05 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:32.457472+0000", 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3225999999999997e-05 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.473 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67248 5.5 5:a68a35cc:::benchmark_data_smithi045_43640_object67247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.138727+0000", 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.25594209600000001, 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016316765, 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67248 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.474 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.138727+0000", 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.138727+0000", 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.138727+0000", 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.138761+0000", 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4359000000000001e-05 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.138768+0000", 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6440000000000003e-06 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.138773+0000", 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.011e-06 2024-04-26T12:10:35.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.143905+0000", 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051318630000000004 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.143990+0000", 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5805999999999998e-05 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.144084+0000", 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3498999999999994e-05 2024-04-26T12:10:35.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.149101+0000", 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050168529999999999 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.154971+0000", 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0058706619999999996 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.155010+0000", 2024-04-26T12:10:35.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8424999999999999e-05 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.155044+0000", 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4165000000000002e-05 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67491 5.1 e27/17 5:8916498a:::benchmark_data_smithi045_43640_object67490:head v 27'4186, mlcod=27'4184)", 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.14466269900000001, 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016815354000000001, 2024-04-26T12:10:35.479 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250006+0000", 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250771+0000", 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00076450699999999999 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250778+0000", 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3969999999999997e-06 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250785+0000", 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0369999999999997e-06 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250820+0000", 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5237000000000002e-05 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250841+0000", 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0582999999999999e-05 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266774+0000", 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015933251999999998 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266822+0000", 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7877999999999998e-05 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67493 5.a 5:5e743bfb:::benchmark_data_smithi045_43640_object67492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.14385525900000001, 2024-04-26T12:10:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017457750000000001, 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67493 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250813+0000", 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250842+0000", 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8741000000000001e-05 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250852+0000", 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0703999999999999e-05 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250860+0000", 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5750000000000003e-06 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250902+0000", 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1804999999999997e-05 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251047+0000", 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014501499999999999 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251201+0000", 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015446700000000001 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264294+0000", 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013092922 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266806+0000", 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025118480000000001 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.268233+0000", 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001427286 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.268272+0000", 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8563000000000003e-05 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.488 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.14369436499999999, 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.489 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:35.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:35.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:35.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67500 5.1 e27/17 5:838173f4:::benchmark_data_smithi045_43640_object67499:head v 27'4188, mlcod=27'4184)", 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.140969449, 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016872364000000001, 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253699+0000", 2024-04-26T12:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253764+0000", 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4362999999999993e-05 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253772+0000", 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253777+0000", 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6210000000000003e-06 2024-04-26T12:10:35.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261979+0000", 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0082025480000000005 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262001+0000", 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1922000000000001e-05 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.270538+0000", 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085369130000000001 2024-04-26T12:10:35.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.270572+0000", 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4097000000000002e-05 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67507 5.2 e27/17 5:443fa10b:::benchmark_data_smithi045_43640_object67506:head v 27'4215, mlcod=27'4213)", 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.13877979200000001, 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018353926, 2024-04-26T12:10:35.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:35.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255889+0000", 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255947+0000", 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8270999999999998e-05 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255957+0000", 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255962+0000", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7620000000000001e-06 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264264+0000", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0083020190000000008 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264277+0000", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274205+0000", 2024-04-26T12:10:35.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099278430000000004 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274243+0000", 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8785999999999998e-05 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:35.502 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:35.504 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.501+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:35.604 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.602+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 23 16 68258 68242 185.42 135.5 0.00396511 0.00538902 2024-04-26T12:10:35.683 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:35.683 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:68430 5.5 e27/17 5:ad07e90f:::benchmark_data_smithi045_43640_object68429:head v 27'4209, mlcod=27'4207)", 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.679652+0000", 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0027758409999999998, 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002801684, 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679652+0000", 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679652+0000", 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679651+0000", 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679728+0000", 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6575999999999993e-05 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679734+0000", 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679738+0000", 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6349999999999999e-06 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679771+0000", 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2984000000000001e-05 2024-04-26T12:10:35.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679790+0000", 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9851e-05 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:68432 5.9 5:9079fbd2:::benchmark_data_smithi045_43640_object68431:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.679250+0000", 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0031774440000000002, 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032694590000000002, 2024-04-26T12:10:35.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 68432 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679250+0000", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679250+0000", 2024-04-26T12:10:35.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679249+0000", 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681108+0000", 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018583860000000001 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681120+0000", 2024-04-26T12:10:35.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2811e-05 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681129+0000", 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8680000000000005e-06 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681162+0000", 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2975000000000002e-05 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681257+0000", 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4560000000000003e-05 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681345+0000", 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8566000000000006e-05 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:68434 5.6 e27/17 5:6b4e1ada:::benchmark_data_smithi045_43640_object68433:head v 27'4231, mlcod=27'4227)", 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.681664+0000", 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.000763399, 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00091734, 2024-04-26T12:10:35.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681664+0000", 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681664+0000", 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681663+0000", 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681718+0000", 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4292999999999997e-05 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681728+0000", 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8139999999999995e-06 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.681733+0000", 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4450000000000004e-06 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.682366+0000", 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063260699999999998 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.682384+0000", 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7971000000000001e-05 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:68425 5.7 5:e17092be:::benchmark_data_smithi045_43640_object68424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.676941+0000", 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.005486075, 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005677339, 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 68425 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.676941+0000", 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.676941+0000", 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.676941+0000", 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677030+0000", 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8715999999999996e-05 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677037+0000", 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6860000000000006e-06 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677042+0000", 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9230000000000001e-06 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677098+0000", 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6320000000000003e-05 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677219+0000", 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120697 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677346+0000", 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012685600000000001 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.682279+0000", 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049331729999999999 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:68422 5.d e27/17 5:b3d11931:::benchmark_data_smithi045_43640_object68421:head v 27'4213, mlcod=27'4211)", 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.677162+0000", 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0052654989999999999, 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055013459999999998, 2024-04-26T12:10:35.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677162+0000", 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677162+0000", 2024-04-26T12:10:35.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677161+0000", 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677251+0000", 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9228999999999996e-05 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677259+0000", 2024-04-26T12:10:35.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8009999999999993e-06 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677266+0000", 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6499999999999999e-06 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677299+0000", 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3330000000000001e-05 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677317+0000", 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7561999999999999e-05 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:68426 5.c e27/17 5:31ca3f6f:::benchmark_data_smithi045_43640_object68425:head v 27'4303, mlcod=27'4300)", 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.677466+0000", 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0049613290000000004, 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052378440000000002, 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677466+0000", 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677466+0000", 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677466+0000", 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677545+0000", 2024-04-26T12:10:35.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9670000000000001e-05 2024-04-26T12:10:35.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677554+0000", 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.677561+0000", 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0679999999999999e-06 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.678737+0000", 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001176641 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.678763+0000", 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5763e-05 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:68423 5.6 e27/17 5:6b506db9:::benchmark_data_smithi045_43640_object68422:head v 27'4230, mlcod=27'4227)", 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.679222+0000", 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0032052299999999999, 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035314930000000001, 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:35.707 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679222+0000", 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679222+0000", 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679222+0000", 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679293+0000", 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1559999999999999e-05 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679305+0000", 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1654999999999999e-05 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679313+0000", 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3939999999999996e-06 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679349+0000", 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6018e-05 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679369+0000", 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9412e-05 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4719.0:68428 5.c e27/17 5:3ddd2b11:::benchmark_data_smithi045_43640_object68427:head v 27'4304, mlcod=27'4300)", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.679495+0000", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.0029328380000000001, 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032941899999999998, 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679495+0000", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679495+0000", 2024-04-26T12:10:35.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679494+0000", 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679560+0000", 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5971999999999998e-05 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679567+0000", 2024-04-26T12:10:35.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8870000000000003e-06 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.679572+0000", 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3780000000000003e-06 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.682344+0000", 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027723589999999998 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.682365+0000", 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0959e-05 2024-04-26T12:10:35.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-26T12:10:35.714 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 8 2024-04-26T12:10:35.714 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:35.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:35.716 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.713+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.817 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:35.815+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:35.890 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:35.891 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:10:35.891 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-26T12:10:35.891 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-26T12:10:35.891 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:35.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:35.916 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:35.914+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:35.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:10:36.017 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:36.015+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:36.086 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:10:36.086 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-26T12:10:36.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-26T12:10:36.086 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-26T12:10:36.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33759 5.1 5:84a1f1a6:::benchmark_data_smithi045_43640_object33758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.46634126, 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016968066, 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33759 2024-04-26T12:10:36.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616449+0000", 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616495+0000", 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5689999999999998e-05 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616500+0000", 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6540000000000004e-06 2024-04-26T12:10:36.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.616504+0000", 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622769+0000", 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062649180000000004 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622858+0000", 2024-04-26T12:10:36.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9061000000000007e-05 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.622968+0000", 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109968 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.626085+0000", 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031169380000000001 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633354+0000", 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007269195 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633393+0000", 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-05 2024-04-26T12:10:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.633417+0000", 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4714000000000001e-05 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33877 5.f 5:f51a14f1:::benchmark_data_smithi045_43640_object33876:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:36.093 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.422899792000001, 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018870086000000001, 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33877 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659891+0000", 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.659890+0000", 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660025+0000", 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013460999999999999 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660034+0000", 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5610000000000004e-06 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660042+0000", 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6539999999999999e-06 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662113+0000", 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020712669999999999 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662224+0000", 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111047 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.662342+0000", 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117724 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674933+0000", 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012590874 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678698+0000", 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003764744 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678727+0000", 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9731999999999999e-05 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678761+0000", 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3689999999999998e-05 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33879 5.f 5:fe04d5bf:::benchmark_data_smithi045_43640_object33878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.42273893, 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018825173000000001, 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.099 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33879 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660052+0000", 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660051+0000", 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660142+0000", 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1260000000000004e-05 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660165+0000", 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2415000000000001e-05 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660173+0000", 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8939999999999993e-06 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664571+0000", 2024-04-26T12:10:36.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043981319999999999 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664692+0000", 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120973 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.664834+0000", 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014225699999999999 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675098+0000", 2024-04-26T12:10:36.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01026411 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678827+0000", 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037293489999999999 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678850+0000", 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2881e-05 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678877+0000", 2024-04-26T12:10:36.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33880 5.7 5:ed20740e:::benchmark_data_smithi045_43640_object33879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.422610114999999, 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018640117000000001, 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33880 2024-04-26T12:10:36.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660181+0000", 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660180+0000", 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660214+0000", 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3918999999999998e-05 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660223+0000", 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4720000000000001e-06 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660229+0000", 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.105e-06 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663597+0000", 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033676520000000001 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663724+0000", 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012658400000000001 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663845+0000", 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121259 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.674912+0000", 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011067359000000001 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678766+0000", 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038536619999999999 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678792+0000", 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6057000000000001e-05 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678821+0000", 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8759e-05 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33881 5.7 5:e79e3d8f:::benchmark_data_smithi045_43640_object33880:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:36.110 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.422553046999999, 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02032948, 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33881 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660238+0000", 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660237+0000", 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660285+0000", 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7581999999999999e-05 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660295+0000", 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0343000000000001e-05 2024-04-26T12:10:36.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.660302+0000", 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8959999999999997e-06 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675086+0000", 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014784357 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675240+0000", 2024-04-26T12:10:36.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015400599999999999 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.675391+0000", 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015063500000000001 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678883+0000", 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003492242 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680504+0000", 2024-04-26T12:10:36.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001621209 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680544+0000", 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9360000000000003e-05 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680567+0000", 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3405999999999999e-05 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:33890 5.7 5:eb376974:::benchmark_data_smithi045_43640_object33889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.418948182999999, 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017030601999999999, 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 33890 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663842+0000", 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663889+0000", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7574999999999998e-05 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663900+0000", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0547000000000001e-05 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.663907+0000", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676758+0000", 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012851234 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676858+0000", 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9437000000000004e-05 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.676966+0000", 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.678886+0000", 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019195010000000001 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680830+0000", 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001943857 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680854+0000", 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4550999999999999e-05 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:21.680873+0000", 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8879999999999999e-05 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:37840 5.1 5:81ea6f93:::benchmark_data_smithi045_43640_object37839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.059081752999999, 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016557145999999998, 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 37840 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023709+0000", 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023708+0000", 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023816+0000", 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010798600000000001 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023823+0000", 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3329999999999999e-06 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.023829+0000", 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5929999999999996e-06 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024790+0000", 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096075000000000002 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024861+0000", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0808000000000004e-05 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.024934+0000", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3213999999999994e-05 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.027949+0000", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030152529999999999 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040172+0000", 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012223194 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040211+0000", 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8624999999999997e-05 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:23.040266+0000", 2024-04-26T12:10:36.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5133999999999998e-05 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:48201 5.1 5:8834a6b2:::benchmark_data_smithi045_43640_object48200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.0969144699999998, 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017211021, 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 48201 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985876+0000", 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985875+0000", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985974+0000", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8887000000000004e-05 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985985+0000", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0716999999999999e-05 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.985992+0000", 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0099999999999998e-06 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986021+0000", 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9193999999999999e-05 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986114+0000", 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2709999999999998e-05 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.986198+0000", 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3875999999999995e-05 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:26.991350+0000", 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005152607 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003021+0000", 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011671340000000001 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003053+0000", 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1149999999999998e-05 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.003087+0000", 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4533000000000003e-05 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50399 5.7 5:ec508f68:::benchmark_data_smithi045_43640_object50398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2201588149999996, 2024-04-26T12:10:36.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019023064999999999, 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50399 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862632+0000", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862631+0000", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862738+0000", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106563 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862758+0000", 2024-04-26T12:10:36.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0044999999999999e-05 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.862773+0000", 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.868879+0000", 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061068269999999996 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.869013+0000", 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013344400000000001 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.869145+0000", 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013240300000000001 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.876895+0000", 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077496470000000001 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881560+0000", 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046651339999999996 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881613+0000", 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3415999999999998e-05 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881655+0000", 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1389e-05 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.140 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:50402 5.7 5:e2d53af1:::benchmark_data_smithi045_43640_object50401:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2181365409999998, 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017115340999999999, 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 50402 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864654+0000", 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864653+0000", 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864724+0000", 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0258000000000004e-05 2024-04-26T12:10:36.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864732+0000", 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6270000000000006e-06 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.864738+0000", 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7420000000000003e-06 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.870921+0000", 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006182786 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.871111+0000", 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019038200000000001 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.871288+0000", 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017691699999999999 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.876980+0000", 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005691537 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881703+0000", 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047232660000000003 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881744+0000", 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1010999999999997e-05 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:27.881769+0000", 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5531999999999999e-05 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59443 5.7 5:ec0e963c:::benchmark_data_smithi045_43640_object59442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4075643329999998, 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019184587999999999, 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59443 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675226+0000", 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675342+0000", 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116469 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675355+0000", 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2839e-05 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675361+0000", 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.835e-06 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675397+0000", 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6177000000000003e-05 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675533+0000", 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013585800000000001 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.675679+0000", 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014642100000000001 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679131+0000", 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034519030000000001 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694316+0000", 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015185269 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694371+0000", 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4203000000000003e-05 2024-04-26T12:10:36.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694411+0000", 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0367999999999997e-05 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59449 5.7 5:eb5c443a:::benchmark_data_smithi045_43640_object59448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.676823+0000", 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4059673989999997, 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017671829999999999, 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.151 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59449 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676823+0000", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676823+0000", 2024-04-26T12:10:36.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676822+0000", 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676901+0000", 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8282999999999996e-05 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676909+0000", 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1189999999999997e-06 2024-04-26T12:10:36.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.676916+0000", 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.097e-06 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679153+0000", 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022371819999999999 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679311+0000", 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015810100000000001 2024-04-26T12:10:36.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.679465+0000", 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015371199999999999 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.684852+0000", 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053871079999999998 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694420+0000", 2024-04-26T12:10:36.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095677669999999996 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694462+0000", 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1909999999999997e-05 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694495+0000", 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3402000000000003e-05 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:59452 5.7 5:e35c17ad:::benchmark_data_smithi045_43640_object59451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:31.677922+0000", 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4048688, 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016662412000000001, 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 59452 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.677922+0000", 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.677922+0000", 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.677921+0000", 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.678015+0000", 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4618999999999997e-05 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.678027+0000", 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2268e-05 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.678036+0000", 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1829999999999994e-06 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.682212+0000", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041768090000000001 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.682337+0000", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012420199999999999 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.682447+0000", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109887 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.684992+0000", 2024-04-26T12:10:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025453659999999999 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694503+0000", 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095114819999999999 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694551+0000", 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:31.694584+0000", 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3087999999999999e-05 2024-04-26T12:10:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:67480 5.7 5:e74cc068:::benchmark_data_smithi045_43640_object67479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.244298+0000", 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.83849307799999995, 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019805389, 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67480 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.244298+0000", 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.244298+0000", 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.244297+0000", 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.244334+0000", 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6965000000000003e-05 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.244339+0000", 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9690000000000002e-06 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.244343+0000", 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6739999999999999e-06 2024-04-26T12:10:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.247764+0000", 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003421327 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.247899+0000", 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013525500000000001 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.247995+0000", 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5914000000000004e-05 2024-04-26T12:10:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249708+0000", 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001712961 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.264051+0000", 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014343287999999999 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.264081+0000", 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9964999999999999e-05 2024-04-26T12:10:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.264103+0000", 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1671999999999999e-05 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:67491 5.1 5:8916498a:::benchmark_data_smithi045_43640_object67490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.249516+0000", 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.83327473399999996, 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017613316, 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67491 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249516+0000", 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249516+0000", 2024-04-26T12:10:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249515+0000", 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249596+0000", 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1515999999999997e-05 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249606+0000", 2024-04-26T12:10:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6479999999999998e-06 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249611+0000", 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2700000000000004e-06 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249649+0000", 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7610000000000001e-05 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249776+0000", 2024-04-26T12:10:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727999999999999 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.249914+0000", 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013795999999999999 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.254985+0000", 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050706370000000002 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.267071+0000", 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01208678 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.267105+0000", 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.267129+0000", 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3892000000000001e-05 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:67500 5.1 5:838173f4:::benchmark_data_smithi045_43640_object67499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.251850+0000", 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.83094081900000005, 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019134475000000001, 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67500 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.251850+0000", 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.251850+0000", 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.251849+0000", 2024-04-26T12:10:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.251954+0000", 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010551400000000001 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.251964+0000", 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3549999999999994e-06 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.251970+0000", 2024-04-26T12:10:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.253483+0000", 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001513597 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.253572+0000", 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8585999999999995e-05 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.253657+0000", 2024-04-26T12:10:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5217999999999996e-05 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.256887+0000", 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003229731 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.270902+0000", 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014015481 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.270948+0000", 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5293000000000002e-05 2024-04-26T12:10:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.270984+0000", 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6581000000000001e-05 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:67507 5.2 5:443fa10b:::benchmark_data_smithi045_43640_object67506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.255363+0000", 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.82742783399999997, 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01979235, 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67507 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255363+0000", 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255363+0000", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255362+0000", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255423+0000", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1618999999999994e-05 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255431+0000", 2024-04-26T12:10:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0269999999999995e-06 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255436+0000", 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8210000000000001e-06 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255470+0000", 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3602000000000001e-05 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255557+0000", 2024-04-26T12:10:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7099000000000001e-05 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.255863+0000", 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000306123 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.260146+0000", 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042833369999999999 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.275098+0000", 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014951177 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.275128+0000", 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0559000000000003e-05 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.275155+0000", 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6939000000000001e-05 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:67798 5.2 5:4db42248:::benchmark_data_smithi045_43640_object67797:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.398654+0000", 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.68413653200000002, 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018331670000000001, 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67798 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.398654+0000", 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.398654+0000", 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.398654+0000", 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.398712+0000", 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8768999999999999e-05 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.398718+0000", 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.398722+0000", 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5420000000000001e-06 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.400110+0000", 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013883680000000001 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.400251+0000", 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014023799999999999 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.400413+0000", 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016248900000000001 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.402194+0000", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001781176 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.416927+0000", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014732666 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.416960+0000", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3368999999999998e-05 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.416986+0000", 2024-04-26T12:10:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5445000000000001e-05 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:68956 5.f 5:f6401168:::benchmark_data_smithi045_43640_object68955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.909615+0000", 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.17317543299999999, 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016702765000000001, 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 68956 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.909615+0000", 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.909615+0000", 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.909614+0000", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.909680+0000", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5306000000000001e-05 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.909689+0000", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1819999999999995e-06 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.909696+0000", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.914884+0000", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051882020000000003 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.914994+0000", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109812 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.915128+0000", 2024-04-26T12:10:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013387699999999999 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.919552+0000", 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044237349999999998 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.926227+0000", 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0066749499999999998 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.926279+0000", 2024-04-26T12:10:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1753999999999999e-05 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.926318+0000", 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4719.0:68965 5.7 5:e12603be:::benchmark_data_smithi045_43640_object68964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-26T12:10:35.912243+0000", 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.17054796899999999, 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016592549000000002, 2024-04-26T12:10:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4719", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 68965 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.912243+0000", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.912243+0000", 2024-04-26T12:10:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.912242+0000", 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.912358+0000", 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011629900000000001 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.912370+0000", 2024-04-26T12:10:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.189e-05 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.912377+0000", 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.919578+0000", 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072006029999999999 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.919731+0000", 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015359299999999999 2024-04-26T12:10:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.919848+0000", 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011704700000000001 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.926259+0000", 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064113199999999999 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.928744+0000", 2024-04-26T12:10:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024848359999999998 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.928797+0000", 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2519000000000003e-05 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-26T12:10:35.928835+0000", 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8362000000000003e-05 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-26T12:10:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-26T12:10:36.200 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:10:36.202 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:36.202 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:36.199+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:36.302 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:36.300+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:36.373 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:36.373 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:36.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.373 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69975 5.d 5:b210b345:::benchmark_data_smithi045_43640_object69974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.373 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.365845+0000", 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0060420129999999997, 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0060653820000000002, 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69975 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365845+0000", 2024-04-26T12:10:36.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365845+0000", 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365844+0000", 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365896+0000", 2024-04-26T12:10:36.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2490000000000001e-05 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365908+0000", 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1422e-05 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365916+0000", 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.371e-06 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.365960+0000", 2024-04-26T12:10:36.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4076999999999998e-05 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366065+0000", 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010500100000000001 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366147+0000", 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2071999999999996e-05 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.368186+0000", 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020381230000000002 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69977 5.e 5:7b0676ba:::benchmark_data_smithi045_43640_object69976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.366222+0000", 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0056651310000000003, 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0057426100000000004, 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69977 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366222+0000", 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366222+0000", 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366221+0000", 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366312+0000", 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1148000000000002e-05 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366323+0000", 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0402e-05 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366332+0000", 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4879999999999996e-06 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366382+0000", 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9988999999999999e-05 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366527+0000", 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014506499999999999 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.366734+0000", 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000206541 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.369540+0000", 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0028066419999999998 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69984 5.b 5:d4e6feff:::benchmark_data_smithi045_43640_object69983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.382 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.370091+0000", 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0017957959999999999, 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019203790000000001, 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69984 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370091+0000", 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370091+0000", 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370090+0000", 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370146+0000", 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6400999999999998e-05 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370155+0000", 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0979999999999994e-06 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370159+0000", 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370186+0000", 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6358000000000001e-05 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370272+0000", 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6544000000000004e-05 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370361+0000", 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8621000000000004e-05 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.386 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69986 5.b 5:d2d527cb:::benchmark_data_smithi045_43640_object69985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.370558+0000", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0013289759999999999, 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014966580000000001, 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69986 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370558+0000", 2024-04-26T12:10:36.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370558+0000", 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370557+0000", 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370639+0000", 2024-04-26T12:10:36.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2516999999999996e-05 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370650+0000", 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0562e-05 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.370658+0000", 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2279999999999998e-06 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371615+0000", 2024-04-26T12:10:36.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00095674400000000004 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371708+0000", 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2964e-05 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371796+0000", 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7898000000000004e-05 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:69987 5.a e27/17 5:5fa55f12:::benchmark_data_smithi045_43640_object69986:head v 27'4325, mlcod=27'4323)", 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.371201+0000", 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00068551400000000002, 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000893474, 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371201+0000", 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371201+0000", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371201+0000", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371272+0000", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1338e-05 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371282+0000", 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371289+0000", 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9580000000000001e-06 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371335+0000", 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5958999999999998e-05 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371359+0000", 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4306000000000001e-05 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69990 5.b 5.6733c6db (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.371334+0000", 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00055265700000000002, 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00079294000000000001, 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.394 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69990 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371334+0000", 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371334+0000", 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371333+0000", 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371458+0000", 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012485 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371476+0000", 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7424000000000001e-05 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.371483+0000", 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1459999999999999e-06 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 6 2024-04-26T12:10:36.397 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:36.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:36.403 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:36.401+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:36.505 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:36.503+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:36.578 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:36.579 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:36.579 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:36.579 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:36.579 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:36.592 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:36.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 24 16 70512 70496 183.563 140.875 0.00882409 0.00544462 2024-04-26T12:10:36.634 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:36.632+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:36.706 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:36.704+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:36.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:36.807 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:36.805+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:36.808 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.8823176040000007, 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.809 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48066 5.e 5:7af911c1:::benchmark_data_smithi045_43640_object48065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:36.814 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.8800265080000003, 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017632022000000001, 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48066 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925968+0000", 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926028+0000", 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9240999999999997e-05 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926038+0000", 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0658e-05 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926046+0000", 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928423+0000", 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023775649999999999 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928555+0000", 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131803 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928694+0000", 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013876599999999999 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930779+0000", 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020856389999999998 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943512+0000", 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012732579000000001 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943564+0000", 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1796999999999999e-05 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943601+0000", 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7635999999999997e-05 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.819 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48204 5.4 5:2e474d3f:::benchmark_data_smithi045_43640_object48203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.8191923659999993, 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01638158, 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48204 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.820 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986886+0000", 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2893999999999996e-05 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986895+0000", 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6490000000000003e-06 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986903+0000", 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.486e-06 2024-04-26T12:10:36.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986937+0000", 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3998000000000002e-05 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.987034+0000", 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6916999999999994e-05 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.987116+0000", 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2508000000000004e-05 2024-04-26T12:10:36.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.988821+0000", 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017053210000000001 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003108+0000", 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014286695 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003148+0000", 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459000000000003e-05 2024-04-26T12:10:36.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003185+0000", 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7369000000000001e-05 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48685 5.b 5:deb77a5f:::benchmark_data_smithi045_43640_object48684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.6150023489999992, 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017384601, 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.825 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48685 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191025+0000", 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2106000000000001e-05 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191031+0000", 2024-04-26T12:10:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6039999999999998e-06 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191038+0000", 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4529999999999999e-06 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191062+0000", 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4256e-05 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191147+0000", 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4689000000000002e-05 2024-04-26T12:10:36.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191278+0000", 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013082600000000001 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.193322+0000", 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002044438 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208334+0000", 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015012152000000001 2024-04-26T12:10:36.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208359+0000", 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4765000000000001e-05 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208378+0000", 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8978e-05 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.830 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:57377 5.8 5:12b24460:::benchmark_data_smithi045_43640_object57376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.765512+0000", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.0404840120000003, 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016370665999999999, 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 57377 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765512+0000", 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765512+0000", 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765511+0000", 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765569+0000", 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8239000000000003e-05 2024-04-26T12:10:36.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765578+0000", 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.003e-06 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765586+0000", 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4070000000000004e-06 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765624+0000", 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8081999999999999e-05 2024-04-26T12:10:36.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765728+0000", 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103917 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765820+0000", 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2462999999999999e-05 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.767737+0000", 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019168589999999999 2024-04-26T12:10:36.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.781788+0000", 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014050837 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.781845+0000", 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6669999999999998e-05 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.781882+0000", 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7808999999999997e-05 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.835 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:57392 5.0 5:0f0978f3:::benchmark_data_smithi045_43640_object57391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.0352984950000002, 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016569693999999999, 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 57392 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.836 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770754+0000", 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7460000000000002e-05 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770763+0000", 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.081e-06 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770770+0000", 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8079999999999999e-06 2024-04-26T12:10:36.838 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.772876+0000", 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021058320000000002 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.773008+0000", 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013188100000000001 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.773188+0000", 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000180352 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.774639+0000", 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014514809999999999 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787185+0000", 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012545917 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787231+0000", 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6091000000000003e-05 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787267+0000", 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5537000000000002e-05 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.2787072430000004, 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.841 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59513 5.8 5:1b871bd1:::benchmark_data_smithi045_43640_object59512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:36.846 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.1007175189999998, 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016948095999999999, 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59513 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.847 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705277+0000", 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705354+0000", 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6872000000000005e-05 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705364+0000", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705370+0000", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4899999999999997e-06 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706613+0000", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012424630000000001 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706759+0000", 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014667099999999999 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706900+0000", 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014048899999999999 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.708557+0000", 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016574350000000001 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722139+0000", 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013581994 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722187+0000", 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7855000000000002e-05 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722226+0000", 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9221000000000003e-05 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:67247 5.0 5:0645b07a:::benchmark_data_smithi045_43640_object67246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.667337147, 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016404439, 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 67247 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:36.852 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138658+0000", 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138777+0000", 2024-04-26T12:10:36.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011933400000000001 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138786+0000", 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2730000000000008e-06 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138792+0000", 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.395e-06 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139596+0000", 2024-04-26T12:10:36.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00080421900000000001 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139718+0000", 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121753 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139879+0000", 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016133799999999999 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.141900+0000", 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020209730000000001 2024-04-26T12:10:36.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.154921+0000", 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013020749999999999 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.155001+0000", 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9659000000000004e-05 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.155063+0000", 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2513000000000003e-05 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.856 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68100 5.d 5:bee81212:::benchmark_data_smithi045_43640_object68099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.2716364339999999, 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019203250000000002, 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68100 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.858 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534394+0000", 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5481999999999997e-05 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534400+0000", 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:36.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534404+0000", 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.585e-06 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536672+0000", 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022677349999999999 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536779+0000", 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107212 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536942+0000", 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016312 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.538894+0000", 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019518739999999999 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553500+0000", 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014605775999999999 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553535+0000", 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5363e-05 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553563+0000", 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7521e-05 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68553 5.8 5:17fa449b:::benchmark_data_smithi045_43640_object68552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.0749527130000001, 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016991656000000001, 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68553 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.863 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.864 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731059+0000", 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.643e-05 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731064+0000", 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8250000000000004e-06 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731067+0000", 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0369999999999999e-06 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735485+0000", 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044181699999999999 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735602+0000", 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117021 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735700+0000", 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8191999999999998e-05 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741356+0000", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0056552190000000004 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.747970+0000", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066147369999999999 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.748002+0000", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1891999999999999e-05 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.748035+0000", 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2419999999999998e-05 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.0744264560000001, 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.868 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:36.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:36.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.0741620160000001, 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.873 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:36.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:36.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68566 5.8 5:10f82518:::benchmark_data_smithi045_43640_object68565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.0714778540000001, 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017449837999999999, 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.878 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68566 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734517+0000", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734594+0000", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6625000000000006e-05 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734604+0000", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9229999999999997e-06 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734610+0000", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.285e-06 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740147+0000", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055365650000000002 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740222+0000", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5360999999999999e-05 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740305+0000", 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3212000000000002e-05 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741894+0000", 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001588884 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751909+0000", 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010015157 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751936+0000", 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6497999999999999e-05 2024-04-26T12:10:36.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751968+0000", 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2073999999999998e-05 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69126 5.4 5:2bcf67ed:::benchmark_data_smithi045_43640_object69125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.82080747099999996, 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017301426000000002, 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.883 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69126 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985187+0000", 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985256+0000", 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8153999999999998e-05 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985266+0000", 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0078000000000001e-05 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985273+0000", 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986297+0000", 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001024196 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986420+0000", 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012266999999999999 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986553+0000", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013349299999999999 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990054+0000", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035008769999999999 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002410+0000", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012356044 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002454+0000", 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4082999999999998e-05 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002490+0000", 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5472000000000002e-05 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69127 5.4 5:2c1dd0bb:::benchmark_data_smithi045_43640_object69126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.82066119299999996, 2024-04-26T12:10:36.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017253923000000001, 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69127 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:36.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985334+0000", 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985384+0000", 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0232000000000003e-05 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985393+0000", 2024-04-26T12:10:36.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3000000000000007e-06 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985399+0000", 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7960000000000001e-06 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988415+0000", 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030155550000000001 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988529+0000", 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000114727 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988675+0000", 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014572899999999999 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990392+0000", 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017169869999999999 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002528+0000", 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012135633 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002566+0000", 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002589+0000", 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2583e-05 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69380 5.e 5:7fcd3378:::benchmark_data_smithi045_43640_object69379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.70188546500000004, 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017901108999999998, 2024-04-26T12:10:36.893 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69380 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104141+0000", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1442000000000002e-05 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104149+0000", 2024-04-26T12:10:36.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8599999999999993e-06 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104155+0000", 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106041+0000", 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001886268 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106150+0000", 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109609 2024-04-26T12:10:36.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106287+0000", 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.108987+0000", 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026995230000000001 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121935+0000", 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012948406000000001 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121979+0000", 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3568e-05 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.122011+0000", 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2629999999999998e-05 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69739 5.8 5:1a2f062f:::benchmark_data_smithi045_43640_object69738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:36.898 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.54725396400000004, 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016760225, 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69739 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258741+0000", 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258840+0000", 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9241999999999996e-05 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258851+0000", 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1144e-05 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258858+0000", 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6760000000000001e-06 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265394+0000", 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065353870000000001 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265522+0000", 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012853800000000001 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265678+0000", 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000156362 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.273601+0000", 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0079224480000000003 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275386+0000", 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001784716 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275458+0000", 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2669000000000005e-05 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275502+0000", 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3778e-05 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.903 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.27040771699999999, 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.904 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70404 5.8 5:1adab04b:::benchmark_data_smithi045_43640_object70403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.249237194, 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016676092, 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:36.909 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70404 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556758+0000", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556777+0000", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8961999999999999e-05 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556781+0000", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.907e-06 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:36.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556786+0000", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9309999999999999e-06 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563428+0000", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066422010000000004 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563504+0000", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5354999999999999e-05 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563580+0000", 2024-04-26T12:10:36.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6423999999999999e-05 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.570893+0000", 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073131840000000004 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573311+0000", 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024173860000000001 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573386+0000", 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5760999999999995e-05 2024-04-26T12:10:36.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573435+0000", 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8374999999999997e-05 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:36.914 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:36.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:36.916 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:36.913+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:36.971 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:36.972 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:10:36.993 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:37.016 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:37.014+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:37.017 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:37.101 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:37.102 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:37.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:37.117 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:37.116+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:37.217 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:37.216+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:37.312 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:37.312 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:37.318 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:37.317+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:37.328 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:37.418 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:37.416+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:37.513 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:37.513 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:37.519 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:37.517+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:37.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:10:37.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 25 16 72697 72681 181.683 136.562 0.00504101 0.00550059 2024-04-26T12:10:37.620 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:37.618+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:37.708 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:37.708 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:37.721 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:37.720+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:37.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:10:37.821 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:37.819+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:37.922 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:37.920+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:37.938 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:37.939 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:37.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:10:38.022 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:38.020+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:38.123 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:38.121+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:38.170 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:38.170 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:38.184 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:38.226 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:38.224+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:38.325 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:38.323+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:38.361 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:38.361 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:38.377 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:38.427 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:38.425+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:38.528 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:10:38.526+0000 7fc0db4a9700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40433) UID: 0 2024-04-26T12:10:38.552 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:38.552 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:38.567 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:38.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 26 16 74973 74957 180.166 142.25 0.0065609 0.00554671 2024-04-26T12:10:38.628 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:38.627+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:38.696 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:10:38.696 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:38.696 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-26T12:10:38.697 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:10:38.697 INFO:teuthology.orchestra.console.smithi071:Power off 2024-04-26T12:10:38.697 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T12:10:38.723 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-04-26T12:10:38.723 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:10:38.733 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:38.730+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:38.741 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:38.741 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:38.746 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-26T12:10:38.755 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:38.834 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:38.832+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:38.935 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:38.933+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:38.969 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:38.969 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:38.981 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:38.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:10:39.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:39.035 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.033+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.135 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:39.134+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:39.164 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:39.164 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:39.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:39.210 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:39.232 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:39.236 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.234+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.255 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:39.256 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:39.256 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:39.256 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:39.337 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.335+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.472022748000001, 2024-04-26T12:10:39.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:39.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:39.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:39.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48066 5.e 5:7af911c1:::benchmark_data_smithi045_43640_object48065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.469731652, 2024-04-26T12:10:39.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017632022000000001, 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48066 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925968+0000", 2024-04-26T12:10:39.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926028+0000", 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9240999999999997e-05 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926038+0000", 2024-04-26T12:10:39.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0658e-05 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926046+0000", 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928423+0000", 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023775649999999999 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928555+0000", 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131803 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928694+0000", 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013876599999999999 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930779+0000", 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020856389999999998 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943512+0000", 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012732579000000001 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943564+0000", 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1796999999999999e-05 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943601+0000", 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7635999999999997e-05 2024-04-26T12:10:39.412 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48204 5.4 5:2e474d3f:::benchmark_data_smithi045_43640_object48203:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.408897509999999, 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01638158, 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.413 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48204 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986803+0000", 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986886+0000", 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2893999999999996e-05 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986895+0000", 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6490000000000003e-06 2024-04-26T12:10:39.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986903+0000", 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.486e-06 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.986937+0000", 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3998000000000002e-05 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.987034+0000", 2024-04-26T12:10:39.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6916999999999994e-05 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.987116+0000", 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2508000000000004e-05 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.988821+0000", 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017053210000000001 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003108+0000", 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014286695 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003148+0000", 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459000000000003e-05 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.003185+0000", 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7369000000000001e-05 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48685 5.b 5:deb77a5f:::benchmark_data_smithi045_43640_object48684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.204707493000001, 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017384601, 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48685 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.419 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191025+0000", 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2106000000000001e-05 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191031+0000", 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6039999999999998e-06 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191038+0000", 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4529999999999999e-06 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191062+0000", 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4256e-05 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191147+0000", 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4689000000000002e-05 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191278+0000", 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013082600000000001 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.193322+0000", 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002044438 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208334+0000", 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015012152000000001 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208359+0000", 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4765000000000001e-05 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208378+0000", 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8978e-05 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.424 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:57377 5.8 5:12b24460:::benchmark_data_smithi045_43640_object57376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.765512+0000", 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.6301891560000001, 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016370665999999999, 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 57377 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765512+0000", 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765512+0000", 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765511+0000", 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765569+0000", 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8239000000000003e-05 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765578+0000", 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.003e-06 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765586+0000", 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4070000000000004e-06 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765624+0000", 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8081999999999999e-05 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765728+0000", 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103917 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.765820+0000", 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2462999999999999e-05 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.767737+0000", 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019168589999999999 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.781788+0000", 2024-04-26T12:10:39.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014050837 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.781845+0000", 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6669999999999998e-05 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.781882+0000", 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7808999999999997e-05 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:57392 5.0 5:0f0978f3:::benchmark_data_smithi045_43640_object57391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.6250036389999991, 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016569693999999999, 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 57392 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770754+0000", 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7460000000000002e-05 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770763+0000", 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.081e-06 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770770+0000", 2024-04-26T12:10:39.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8079999999999999e-06 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.772876+0000", 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021058320000000002 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.773008+0000", 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013188100000000001 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.773188+0000", 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000180352 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.774639+0000", 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014514809999999999 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787185+0000", 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012545917 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787231+0000", 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6091000000000003e-05 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787267+0000", 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5537000000000002e-05 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.8684123870000002, 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:39.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59513 5.8 5:1b871bd1:::benchmark_data_smithi045_43640_object59512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.6904226629999997, 2024-04-26T12:10:39.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016948095999999999, 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59513 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705277+0000", 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705354+0000", 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6872000000000005e-05 2024-04-26T12:10:39.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705364+0000", 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705370+0000", 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4899999999999997e-06 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706613+0000", 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012424630000000001 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706759+0000", 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014667099999999999 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706900+0000", 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014048899999999999 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.708557+0000", 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016574350000000001 2024-04-26T12:10:39.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722139+0000", 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013581994 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722187+0000", 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7855000000000002e-05 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722226+0000", 2024-04-26T12:10:39.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9221000000000003e-05 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:67247 5.0 5:0645b07a:::benchmark_data_smithi045_43640_object67246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.2570422910000003, 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016404439, 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.448 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 67247 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138658+0000", 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138777+0000", 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011933400000000001 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138786+0000", 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2730000000000008e-06 2024-04-26T12:10:39.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138792+0000", 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.395e-06 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139596+0000", 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00080421900000000001 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139718+0000", 2024-04-26T12:10:39.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121753 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139879+0000", 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016133799999999999 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.141900+0000", 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020209730000000001 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.154921+0000", 2024-04-26T12:10:39.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013020749999999999 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.155001+0000", 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9659000000000004e-05 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.155063+0000", 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2513000000000003e-05 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68100 5.d 5:bee81212:::benchmark_data_smithi045_43640_object68099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.8613415780000002, 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019203250000000002, 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68100 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.454 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534394+0000", 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5481999999999997e-05 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534400+0000", 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534404+0000", 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.585e-06 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536672+0000", 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022677349999999999 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536779+0000", 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107212 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536942+0000", 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016312 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.538894+0000", 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019518739999999999 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553500+0000", 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014605775999999999 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553535+0000", 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5363e-05 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553563+0000", 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7521e-05 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.459 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68553 5.8 5:17fa449b:::benchmark_data_smithi045_43640_object68552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.6646578569999999, 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016991656000000001, 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68553 2024-04-26T12:10:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:39.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731059+0000", 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.643e-05 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731064+0000", 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8250000000000004e-06 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731067+0000", 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0369999999999999e-06 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735485+0000", 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044181699999999999 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735602+0000", 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117021 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735700+0000", 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8191999999999998e-05 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741356+0000", 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0056552190000000004 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.747970+0000", 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066147369999999999 2024-04-26T12:10:39.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.748002+0000", 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1891999999999999e-05 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.748035+0000", 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2419999999999998e-05 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.465 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.6641316000000002, 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.6638671600000001, 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:39.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68566 5.8 5:10f82518:::benchmark_data_smithi045_43640_object68565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.477 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.6611829980000001, 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017449837999999999, 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68566 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734517+0000", 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734594+0000", 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6625000000000006e-05 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734604+0000", 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9229999999999997e-06 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734610+0000", 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.285e-06 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740147+0000", 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055365650000000002 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740222+0000", 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5360999999999999e-05 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740305+0000", 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3212000000000002e-05 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741894+0000", 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001588884 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751909+0000", 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010015157 2024-04-26T12:10:39.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751936+0000", 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6497999999999999e-05 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751968+0000", 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2073999999999998e-05 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69126 5.4 5:2bcf67ed:::benchmark_data_smithi045_43640_object69125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.410512615, 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017301426000000002, 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69126 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985187+0000", 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985256+0000", 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8153999999999998e-05 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985266+0000", 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0078000000000001e-05 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985273+0000", 2024-04-26T12:10:39.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986297+0000", 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001024196 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986420+0000", 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012266999999999999 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986553+0000", 2024-04-26T12:10:39.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013349299999999999 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990054+0000", 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035008769999999999 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002410+0000", 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012356044 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002454+0000", 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4082999999999998e-05 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002490+0000", 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5472000000000002e-05 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69127 5.4 5:2c1dd0bb:::benchmark_data_smithi045_43640_object69126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.4103663370000001, 2024-04-26T12:10:39.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017253923000000001, 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69127 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985334+0000", 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985384+0000", 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0232000000000003e-05 2024-04-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985393+0000", 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3000000000000007e-06 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985399+0000", 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7960000000000001e-06 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988415+0000", 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030155550000000001 2024-04-26T12:10:39.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988529+0000", 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000114727 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988675+0000", 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014572899999999999 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990392+0000", 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017169869999999999 2024-04-26T12:10:39.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002528+0000", 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012135633 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002566+0000", 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002589+0000", 2024-04-26T12:10:39.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2583e-05 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69380 5.e 5:7fcd3378:::benchmark_data_smithi045_43640_object69379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.291590609, 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017901108999999998, 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.495 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69380 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104141+0000", 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1442000000000002e-05 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104149+0000", 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8599999999999993e-06 2024-04-26T12:10:39.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104155+0000", 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106041+0000", 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001886268 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106150+0000", 2024-04-26T12:10:39.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109609 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106287+0000", 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.108987+0000", 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026995230000000001 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121935+0000", 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012948406000000001 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121979+0000", 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3568e-05 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.122011+0000", 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2629999999999998e-05 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.500 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69739 5.8 5:1a2f062f:::benchmark_data_smithi045_43640_object69738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.1369591080000001, 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016760225, 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69739 2024-04-26T12:10:39.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258741+0000", 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258840+0000", 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9241999999999996e-05 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258851+0000", 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1144e-05 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258858+0000", 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6760000000000001e-06 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265394+0000", 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065353870000000001 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265522+0000", 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012853800000000001 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265678+0000", 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000156362 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.273601+0000", 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0079224480000000003 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275386+0000", 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001784716 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275458+0000", 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2669000000000005e-05 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275502+0000", 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3778e-05 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 2.8601128610000002, 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:39.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:39.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70404 5.8 5:1adab04b:::benchmark_data_smithi045_43640_object70403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 2.8389423379999998, 2024-04-26T12:10:39.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016676092, 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70404 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:39.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556758+0000", 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556777+0000", 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8961999999999999e-05 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:39.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556781+0000", 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.907e-06 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556786+0000", 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9309999999999999e-06 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563428+0000", 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066422010000000004 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:39.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563504+0000", 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5354999999999999e-05 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563580+0000", 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6423999999999999e-05 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.570893+0000", 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073131840000000004 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573311+0000", 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024173860000000001 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573386+0000", 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5760999999999995e-05 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573435+0000", 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8374999999999997e-05 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.517 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.518 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:39.518 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:39.518 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:39.519 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.517+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:39.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 27 16 77243 77227 178.747 141.875 0.003426 0.00559074 2024-04-26T12:10:39.620 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:39.619+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77434 5.0 e28/17 5:0436d724:::benchmark_data_smithi045_43640_object77433:head v 28'4887, mlcod=28'4885)", 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.699311+0000", 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036566419999999999, 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0036827349999999999, 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699311+0000", 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699311+0000", 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699310+0000", 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699403+0000", 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2304000000000003e-05 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699411+0000", 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8269999999999998e-06 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699416+0000", 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2920000000000003e-06 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699445+0000", 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9626999999999999e-05 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699460+0000", 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4633e-05 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77440 5.a 5:529b7bd8:::benchmark_data_smithi045_43640_object77439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:39.708 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.699327+0000", 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036404699999999998, 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0037427290000000002, 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77440 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699327+0000", 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699327+0000", 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699326+0000", 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699479+0000", 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015302800000000001 2024-04-26T12:10:39.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699486+0000", 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7830000000000001e-06 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699494+0000", 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6469999999999998e-06 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699528+0000", 2024-04-26T12:10:39.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4758999999999997e-05 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699670+0000", 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000141445 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699837+0000", 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016697700000000001 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77436 5.4 e28/17 5:2656eedf:::benchmark_data_smithi045_43640_object77435:head v 28'4911, mlcod=28'4908)", 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.699422+0000", 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035455740000000001, 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0037230800000000001, 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699422+0000", 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699422+0000", 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699422+0000", 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699492+0000", 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0776000000000001e-05 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699497+0000", 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8420000000000004e-06 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699501+0000", 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4189999999999998e-06 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699531+0000", 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0514999999999998e-05 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699549+0000", 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7836999999999999e-05 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77438 5.7 e28/17 5:ef16f1c5:::benchmark_data_smithi045_43640_object77437:head v 28'4989, mlcod=28'4986)", 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.699599+0000", 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003368785, 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0036068229999999999, 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699599+0000", 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699599+0000", 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699598+0000", 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699658+0000", 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9216999999999999e-05 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699666+0000", 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0839999999999992e-06 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699671+0000", 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1989999999999997e-06 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699722+0000", 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1205999999999997e-05 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699738+0000", 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6407999999999999e-05 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77441 5.c 5:36f55176:::benchmark_data_smithi045_43640_object77440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.699842+0000", 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031258729999999999, 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0034295770000000001, 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77441 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699842+0000", 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699842+0000", 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699841+0000", 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699863+0000", 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2130999999999999e-05 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699871+0000", 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8290000000000008e-06 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699877+0000", 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.699924+0000", 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6882000000000003e-05 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.700000+0000", 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6150999999999996e-05 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.700103+0000", 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000102657 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77445 5.c 5:3feb1623:::benchmark_data_smithi045_43640_object77444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.701126+0000", 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0018412669999999999, 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002226867, 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.724 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77445 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701126+0000", 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701126+0000", 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701125+0000", 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701176+0000", 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1035999999999997e-05 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701188+0000", 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2021000000000001e-05 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701196+0000", 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3420000000000002e-06 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701672+0000", 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00047650600000000002 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701808+0000", 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013621600000000001 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701907+0000", 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9066000000000003e-05 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77442 5.0 e28/17 5:09db1ba3:::benchmark_data_smithi045_43640_object77441:head v 28'4888, mlcod=28'4885)", 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.701272+0000", 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0016954419999999999, 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021344189999999998, 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.728 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701272+0000", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701272+0000", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701271+0000", 2024-04-26T12:10:39.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701330+0000", 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8294000000000001e-05 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701342+0000", 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1765e-05 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701347+0000", 2024-04-26T12:10:39.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2229999999999998e-06 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701556+0000", 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020876799999999999 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701573+0000", 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7442e-05 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.731 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77439 5.4 e28/17 5:251d3840:::benchmark_data_smithi045_43640_object77438:head v 28'4912, mlcod=28'4909)", 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.701465+0000", 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0015027669999999999, 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020021850000000001, 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701465+0000", 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701465+0000", 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701464+0000", 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701526+0000", 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2022999999999999e-05 2024-04-26T12:10:39.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701535+0000", 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2430000000000005e-06 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701540+0000", 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7780000000000004e-06 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701611+0000", 2024-04-26T12:10:39.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0722999999999994e-05 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701626+0000", 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5268e-05 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77443 5.7 e28/17 5:e2c29e6a:::benchmark_data_smithi045_43640_object77442:head v 28'4990, mlcod=28'4986)", 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.701673+0000", 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0012941770000000001, 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001857645, 2024-04-26T12:10:39.735 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701673+0000", 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701673+0000", 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701673+0000", 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701786+0000", 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113519 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701795+0000", 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3799999999999994e-06 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701801+0000", 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701836+0000", 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5709e-05 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701854+0000", 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.806e-05 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:77446 5.e e28/17 5:7e9463d3:::benchmark_data_smithi045_43640_object77445:head v 28'4883, mlcod=28'4881)", 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.701691+0000", 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001276639, 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00190295, 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701691+0000", 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701691+0000", 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701691+0000", 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701787+0000", 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6686000000000002e-05 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701796+0000", 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.701803+0000", 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3029999999999996e-06 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702924+0000", 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001121513 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702947+0000", 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3230999999999998e-05 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77447 5.5 5:ae3f6ab9:::benchmark_data_smithi045_43640_object77446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:39.742 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.702264+0000", 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00070319399999999998, 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013982459999999999, 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77447 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702264+0000", 2024-04-26T12:10:39.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702264+0000", 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702263+0000", 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702319+0000", 2024-04-26T12:10:39.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6053e-05 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702330+0000", 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0608000000000001e-05 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702337+0000", 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.216e-06 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702377+0000", 2024-04-26T12:10:39.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9919000000000002e-05 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702499+0000", 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012144199999999999 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.702633+0000", 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013460100000000001 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:39.747 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 11 2024-04-26T12:10:39.747 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:39.748 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:39.749 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.746+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.849 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.847+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.950 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:39.948+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:39.976 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:39.976 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:39.976 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:39.976 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:39.976 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:39.978 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:10:39.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:40.052 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:40.051+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:40.153 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:40.152+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:40.217 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:40.218 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 50.847795310999999, 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:40.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:40.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:40.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 50.847722973000003, 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:40.226 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:40.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45154 5.5 5:a06af483:::benchmark_data_smithi045_43640_object45153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.42792251, 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016862312000000001, 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45154 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785759+0000", 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785855+0000", 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6248000000000004e-05 2024-04-26T12:10:40.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785865+0000", 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2569999999999996e-06 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785872+0000", 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1579999999999999e-06 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785914+0000", 2024-04-26T12:10:40.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1968000000000002e-05 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786045+0000", 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000131407 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786145+0000", 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000100283 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792782+0000", 2024-04-26T12:10:40.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066362549999999998 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802539+0000", 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0097571619999999998 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802585+0000", 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802623+0000", 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7979999999999999e-05 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48681 5.3 5:cb5c3d78:::benchmark_data_smithi045_43640_object48680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.023319305999999, 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017718434000000002, 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.241 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48681 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190440+0000", 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7012000000000001e-05 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190449+0000", 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:10:40.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190458+0000", 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190486+0000", 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8527999999999999e-05 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190600+0000", 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114209 2024-04-26T12:10:40.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190680+0000", 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9470999999999999e-05 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200074+0000", 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093940699999999992 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208032+0000", 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079582980000000008 2024-04-26T12:10:40.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208060+0000", 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7807e-05 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208082+0000", 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1764e-05 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.246 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48687 5.3 5:cadd13fa:::benchmark_data_smithi045_43640_object48686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.022600173000001, 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017046892000000001, 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.247 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48687 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191082+0000", 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191139+0000", 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6972999999999998e-05 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191149+0000", 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0672999999999999e-05 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191156+0000", 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192066+0000", 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090978800000000002 2024-04-26T12:10:40.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192160+0000", 2024-04-26T12:10:40.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3597000000000005e-05 2024-04-26T12:10:40.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192266+0000", 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000106258 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200102+0000", 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078359610000000007 2024-04-26T12:10:40.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208089+0000", 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079876530000000008 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208112+0000", 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2662000000000001e-05 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208129+0000", 2024-04-26T12:10:40.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7371e-05 2024-04-26T12:10:40.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.254 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.254 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48688 5.3 5:cfd89793:::benchmark_data_smithi045_43640_object48687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.022470991, 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016963124999999999, 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48688 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191211+0000", 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191271+0000", 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0461999999999998e-05 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191284+0000", 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3037000000000001e-05 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191292+0000", 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1429999999999998e-06 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193700+0000", 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024080210000000002 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193836+0000", 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135747 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193961+0000", 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000125084 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200129+0000", 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061672189999999998 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208138+0000", 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0080092600000000007 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208159+0000", 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0834000000000001e-05 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208175+0000", 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6242000000000001e-05 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:57462 5.a 5:58ae117f:::benchmark_data_smithi045_43640_object57461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.4099976109999997, 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017784415000000001, 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.260 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 57462 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803684+0000", 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803792+0000", 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108249 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803805+0000", 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2941e-05 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803815+0000", 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:10:40.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810187+0000", 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063728329999999996 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810321+0000", 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000133287 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810470+0000", 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014878800000000001 2024-04-26T12:10:40.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.815019+0000", 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045490419999999997 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821390+0000", 2024-04-26T12:10:40.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063716229999999999 2024-04-26T12:10:40.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821434+0000", 2024-04-26T12:10:40.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4206000000000003e-05 2024-04-26T12:10:40.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821470+0000", 2024-04-26T12:10:40.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5122e-05 2024-04-26T12:10:40.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.269 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.270 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.270 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:59102 5.e e26/17 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head v 26'3740, mlcod=26'3735)", 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.6835882039999994, 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017035195, 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:40.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530168+0000", 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4119e-05 2024-04-26T12:10:40.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530178+0000", 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530185+0000", 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3999999999999997e-06 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.531272+0000", 2024-04-26T12:10:40.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010875049999999999 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.531290+0000", 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7972999999999999e-05 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.547109+0000", 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015818279000000001 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.547130+0000", 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.107e-05 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67491 5.1 e27/17 5:8916498a:::benchmark_data_smithi045_43640_object67490:head v 27'4186, mlcod=27'4184)", 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9636760400000002, 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016815354000000001, 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.276 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250006+0000", 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250771+0000", 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00076450699999999999 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250778+0000", 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3969999999999997e-06 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250785+0000", 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0369999999999997e-06 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250820+0000", 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5237000000000002e-05 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250841+0000", 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0582999999999999e-05 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266774+0000", 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015933251999999998 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266822+0000", 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7877999999999998e-05 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67493 5.a 5:5e743bfb:::benchmark_data_smithi045_43640_object67492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:40.281 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9628686000000002, 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017457750000000001, 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67493 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250813+0000", 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250842+0000", 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8741000000000001e-05 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250852+0000", 2024-04-26T12:10:40.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0703999999999999e-05 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250860+0000", 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5750000000000003e-06 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250902+0000", 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1804999999999997e-05 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251047+0000", 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014501499999999999 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251201+0000", 2024-04-26T12:10:40.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015446700000000001 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264294+0000", 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013092922 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266806+0000", 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025118480000000001 2024-04-26T12:10:40.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.268233+0000", 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001427286 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.268272+0000", 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8563000000000003e-05 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.288 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9627077059999998, 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:40.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:40.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67500 5.1 e27/17 5:838173f4:::benchmark_data_smithi045_43640_object67499:head v 27'4188, mlcod=27'4184)", 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9599827899999998, 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016872364000000001, 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.296 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:40.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:40.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253699+0000", 2024-04-26T12:10:40.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253764+0000", 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4362999999999993e-05 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253772+0000", 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:10:40.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253777+0000", 2024-04-26T12:10:40.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6210000000000003e-06 2024-04-26T12:10:40.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261979+0000", 2024-04-26T12:10:40.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0082025480000000005 2024-04-26T12:10:40.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262001+0000", 2024-04-26T12:10:40.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1922000000000001e-05 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.270538+0000", 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085369130000000001 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.270572+0000", 2024-04-26T12:10:40.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4097000000000002e-05 2024-04-26T12:10:40.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.305 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67507 5.2 e27/17 5:443fa10b:::benchmark_data_smithi045_43640_object67506:head v 27'4215, mlcod=27'4213)", 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.957793133, 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018353926, 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.306 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.307 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:40.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255889+0000", 2024-04-26T12:10:40.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255947+0000", 2024-04-26T12:10:40.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8270999999999998e-05 2024-04-26T12:10:40.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255957+0000", 2024-04-26T12:10:40.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:10:40.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255962+0000", 2024-04-26T12:10:40.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7620000000000001e-06 2024-04-26T12:10:40.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264264+0000", 2024-04-26T12:10:40.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0083020190000000008 2024-04-26T12:10:40.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264277+0000", 2024-04-26T12:10:40.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:40.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274205+0000", 2024-04-26T12:10:40.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099278430000000004 2024-04-26T12:10:40.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274243+0000", 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8785999999999998e-05 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.315 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:70207 5.3 5:c8420e50:::benchmark_data_smithi045_43640_object70206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:40.316 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:36.464113+0000", 2024-04-26T12:10:40.316 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.7495701979999998, 2024-04-26T12:10:40.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017765534999999999, 2024-04-26T12:10:40.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.316 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.316 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.317 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.317 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.317 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 70207 2024-04-26T12:10:40.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.317 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464113+0000", 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464113+0000", 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464112+0000", 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464223+0000", 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011108900000000001 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464229+0000", 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:10:40.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464234+0000", 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5730000000000001e-06 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467777+0000", 2024-04-26T12:10:40.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035436339999999999 2024-04-26T12:10:40.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467905+0000", 2024-04-26T12:10:40.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012747400000000001 2024-04-26T12:10:40.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.468039+0000", 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013419899999999999 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.471213+0000", 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031744680000000002 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481793+0000", 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010580044 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481840+0000", 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6261000000000003e-05 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481878+0000", 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8438e-05 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.324 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:70211 5.c 5:311f3df0:::benchmark_data_smithi045_43640_object70210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.749162369, 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017354991, 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 70211 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.325 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464584+0000", 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3862000000000006e-05 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464592+0000", 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9980000000000003e-06 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464598+0000", 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3999999999999997e-06 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467250+0000", 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026514939999999999 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467373+0000", 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012313800000000001 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467522+0000", 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149161 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.473308+0000", 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057861029999999999 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481805+0000", 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084968119999999994 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481837+0000", 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2421e-05 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481875+0000", 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8071000000000002e-05 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77464 5.3 5:caff8931:::benchmark_data_smithi045_43640_object77463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.710429+0000", 2024-04-26T12:10:40.332 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.50325405499999998, 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017074038999999999, 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77464 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710429+0000", 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710429+0000", 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710428+0000", 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710466+0000", 2024-04-26T12:10:40.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7431999999999997e-05 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710472+0000", 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3890000000000002e-06 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710479+0000", 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5899999999999996e-06 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.713965+0000", 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0034866540000000001 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.714093+0000", 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012799400000000001 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.714271+0000", 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017812000000000001 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.336 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.719779+0000", 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055074809999999998 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.727423+0000", 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076445100000000002 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.727468+0000", 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4242000000000001e-05 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.727503+0000", 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5141000000000001e-05 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.338 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.40840798499999997, 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:40.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:40.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.236904437, 2024-04-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.350 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78258 5.6 5:645888be:::benchmark_data_smithi045_43640_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:40.081812+0000", 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.131870602, 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017688314, 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78258 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081812+0000", 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081812+0000", 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081811+0000", 2024-04-26T12:10:40.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081879+0000", 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7795999999999999e-05 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081887+0000", 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8089999999999993e-06 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081902+0000", 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4759e-05 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.085920+0000", 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040186830000000003 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.086057+0000", 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013616299999999999 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.086220+0000", 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016353900000000001 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.095847+0000", 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009627254 2024-04-26T12:10:40.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.099406+0000", 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00355844 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.099457+0000", 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0676000000000001e-05 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.099500+0000", 2024-04-26T12:10:40.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3860999999999999e-05 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:78400 5.4 e29/17 5:298bb304:::benchmark_data_smithi045_43640_object78399:head v 29'4958, mlcod=29'4955)", 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.054032232999999999, 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016913348000000002, 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:40.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:40.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159709+0000", 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8881000000000001e-05 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159716+0000", 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5499999999999997e-06 2024-04-26T12:10:40.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159721+0000", 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.578e-06 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159757+0000", 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5660000000000001e-05 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:40.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159777+0000", 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0018999999999999e-05 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.176534+0000", 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016757625000000002 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.176564+0000", 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9516e-05 2024-04-26T12:10:40.361 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.362 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.362 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.362 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:40.362 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:40.362 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:40.364 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:40.362+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:40.365 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:40.464 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:40.463+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:40.538 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:40.539 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:40.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.539 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79240 5.d 5:bccfb2e9:::benchmark_data_smithi045_43640_object79239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.539 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.529147+0000", 2024-04-26T12:10:40.539 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0061308270000000002, 2024-04-26T12:10:40.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061674549999999996, 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79240 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529147+0000", 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529147+0000", 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529146+0000", 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529234+0000", 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8048999999999997e-05 2024-04-26T12:10:40.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529243+0000", 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5820000000000008e-06 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529249+0000", 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5650000000000001e-06 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529278+0000", 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9111999999999998e-05 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529377+0000", 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8466000000000002e-05 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.529463+0000", 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6630000000000002e-05 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.531474+0000", 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020104630000000001 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79247 5.0 5:069bddb0:::benchmark_data_smithi045_43640_object79246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532062+0000", 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003215566, 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033431939999999999, 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.544 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79247 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532062+0000", 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532062+0000", 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532061+0000", 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532122+0000", 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0754000000000001e-05 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532131+0000", 2024-04-26T12:10:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6689999999999995e-06 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532140+0000", 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7580000000000004e-06 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532181+0000", 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0469999999999997e-05 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532331+0000", 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014973699999999999 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532469+0000", 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013816999999999999 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:79243 5.9 e29/17 5:99a9dc8a:::benchmark_data_smithi045_43640_object79242:head v 29'4972, mlcod=29'4969)", 2024-04-26T12:10:40.548 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532206+0000", 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0030712830000000002, 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032744039999999999, 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532206+0000", 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532206+0000", 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532206+0000", 2024-04-26T12:10:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532271+0000", 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4727000000000006e-05 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532279+0000", 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5909999999999996e-06 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532285+0000", 2024-04-26T12:10:40.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5090000000000001e-06 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532329+0000", 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4372999999999997e-05 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532348+0000", 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9201000000000001e-05 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79248 5.d 5:b93b0983:::benchmark_data_smithi045_43640_object79247:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532150+0000", 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0031275949999999999, 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003397237, 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79248 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532150+0000", 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532150+0000", 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532149+0000", 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532324+0000", 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017457 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532332+0000", 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532338+0000", 2024-04-26T12:10:40.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7129999999999999e-06 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532367+0000", 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8385e-05 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532441+0000", 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.449e-05 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532526+0000", 2024-04-26T12:10:40.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4802000000000006e-05 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79250 5.8 5:1a0e3251:::benchmark_data_smithi045_43640_object79249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532523+0000", 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0027544919999999999, 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003112493, 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.557 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79250 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532523+0000", 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532523+0000", 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532522+0000", 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532586+0000", 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3998000000000006e-05 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532597+0000", 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0351e-05 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532604+0000", 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.401e-06 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532637+0000", 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3278999999999998e-05 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532755+0000", 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117897 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532888+0000", 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013258000000000001 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79252 5.d 5:bc83426f:::benchmark_data_smithi045_43640_object79251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532613+0000", 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0026640460000000002, 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030981939999999999, 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.561 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79252 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532613+0000", 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532613+0000", 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532613+0000", 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532648+0000", 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5216000000000003e-05 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532671+0000", 2024-04-26T12:10:40.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2889999999999999e-05 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532677+0000", 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534637+0000", 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019603149999999998 2024-04-26T12:10:40.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534778+0000", 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014111500000000001 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534910+0000", 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013144599999999999 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.565 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:79240 5.d e29/17)", 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532728+0000", 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.002549338, 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030518839999999999, 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532728+0000", 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532728+0000", 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532728+0000", 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532732+0000", 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4100000000000001e-06 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532739+0000", 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1609999999999997e-06 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532744+0000", 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1150000000000002e-06 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.570 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:79249 5.f e29/17 5:f0102f38:::benchmark_data_smithi045_43640_object79248:head v 29'5111, mlcod=29'5108)", 2024-04-26T12:10:40.570 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.532749+0000", 2024-04-26T12:10:40.570 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0025284449999999998, 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003089896, 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532749+0000", 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532749+0000", 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532749+0000", 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532782+0000", 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3090999999999999e-05 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532788+0000", 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2759999999999997e-06 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532802+0000", 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3677e-05 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532838+0000", 2024-04-26T12:10:40.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6025000000000002e-05 2024-04-26T12:10:40.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.532855+0000", 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.736e-05 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:79253 5.9 e29/17 5:94b83b7c:::benchmark_data_smithi045_43640_object79252:head v 29'4973, mlcod=29'4970)", 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.533223+0000", 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00205404, 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002675041, 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.533223+0000", 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.533223+0000", 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.533223+0000", 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.533268+0000", 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4577999999999999e-05 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.533280+0000", 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2187e-05 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.533285+0000", 2024-04-26T12:10:40.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4739999999999996e-06 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534007+0000", 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000721526 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534028+0000", 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1174000000000001e-05 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:79254 5.a e29/17 5:5aa7e943:::benchmark_data_smithi045_43640_object79253:head v 29'4923, mlcod=29'4921)", 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.534712+0000", 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00056566600000000004, 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012435390000000001, 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534712+0000", 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534712+0000", 2024-04-26T12:10:40.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534711+0000", 2024-04-26T12:10:40.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534748+0000", 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6380000000000001e-05 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534756+0000", 2024-04-26T12:10:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534762+0000", 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8649999999999998e-06 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534799+0000", 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7125000000000001e-05 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.534819+0000", 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0071000000000001e-05 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79258 5.0 5:0b33fb20:::benchmark_data_smithi045_43640_object79257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.535012+0000", 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00026545900000000001, 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001004832, 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:40.583 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79258 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535012+0000", 2024-04-26T12:10:40.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535012+0000", 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535011+0000", 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535098+0000", 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6531000000000002e-05 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535108+0000", 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0254e-05 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535115+0000", 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3860000000000001e-06 2024-04-26T12:10:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535282+0000", 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016683099999999999 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535406+0000", 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000123707 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:40.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535551+0000", 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000145389 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:79260 5.d 5.cc1a97ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.535191+0000", 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.6361999999999997e-05, 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000894837, 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:40.588 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 79260 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535191+0000", 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535191+0000", 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535191+0000", 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535218+0000", 2024-04-26T12:10:40.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7968000000000001e-05 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535229+0000", 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0861e-05 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535236+0000", 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1099999999999997e-06 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:79255 5.9 e29/17 5:9c00988e:::benchmark_data_smithi045_43640_object79254:head v 29'4974, mlcod=29'4970)", 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.535264+0000", 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.3711e-05, 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00087467899999999995, 2024-04-26T12:10:40.592 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535264+0000", 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535264+0000", 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535263+0000", 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535335+0000", 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1590999999999999e-05 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535343+0000", 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2260000000000005e-06 2024-04-26T12:10:40.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535349+0000", 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535736+0000", 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000387088 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.535758+0000", 2024-04-26T12:10:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1710000000000001e-05 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 13 2024-04-26T12:10:40.596 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:40.597 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:40.595+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:40.598 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:40.605 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 28 16 79414 79398 177.209 135.688 0.00444388 0.00563983 2024-04-26T12:10:40.699 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:40.698+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:40.799 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:40.797+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:40.808 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:40.808 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:40.808 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:40.808 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:40.808 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:40.824 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:40.908 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:40.907+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:41.001 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:41.000+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:41.035 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:41.035 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:41.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:41.035 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:41.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.108312067, 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48066 5.e 5:7af911c1:::benchmark_data_smithi045_43640_object48065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.106020971, 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017632022000000001, 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48066 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925968+0000", 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926028+0000", 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9240999999999997e-05 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926038+0000", 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0658e-05 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926046+0000", 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928423+0000", 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023775649999999999 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928555+0000", 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131803 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928694+0000", 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013876599999999999 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930779+0000", 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020856389999999998 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943512+0000", 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012732579000000001 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943564+0000", 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1796999999999999e-05 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943601+0000", 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7635999999999997e-05 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48685 5.b 5:deb77a5f:::benchmark_data_smithi045_43640_object48684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:41.046 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.840996812, 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017384601, 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48685 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191025+0000", 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2106000000000001e-05 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191031+0000", 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6039999999999998e-06 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191038+0000", 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4529999999999999e-06 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191062+0000", 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4256e-05 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191147+0000", 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4689000000000002e-05 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191278+0000", 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013082600000000001 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.193322+0000", 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002044438 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208334+0000", 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015012152000000001 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208359+0000", 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4765000000000001e-05 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208378+0000", 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8978e-05 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:57392 5.0 5:0f0978f3:::benchmark_data_smithi045_43640_object57391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:41.053 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.261292958, 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016569693999999999, 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 57392 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770697+0000", 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770754+0000", 2024-04-26T12:10:41.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7460000000000002e-05 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770763+0000", 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.081e-06 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.770770+0000", 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8079999999999999e-06 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.772876+0000", 2024-04-26T12:10:41.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021058320000000002 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.773008+0000", 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013188100000000001 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.773188+0000", 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000180352 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.774639+0000", 2024-04-26T12:10:41.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014514809999999999 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787185+0000", 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012545917 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787231+0000", 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6091000000000003e-05 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:30.787267+0000", 2024-04-26T12:10:41.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5537000000000002e-05 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.5047017060000005, 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.059 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59513 5.8 5:1b871bd1:::benchmark_data_smithi045_43640_object59512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.3267119820000008, 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016948095999999999, 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59513 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705278+0000", 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705277+0000", 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705354+0000", 2024-04-26T12:10:41.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6872000000000005e-05 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705364+0000", 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4239999999999999e-06 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.705370+0000", 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4899999999999997e-06 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706613+0000", 2024-04-26T12:10:41.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012424630000000001 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706759+0000", 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014667099999999999 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.706900+0000", 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014048899999999999 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.708557+0000", 2024-04-26T12:10:41.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016574350000000001 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722139+0000", 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013581994 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722187+0000", 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7855000000000002e-05 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.722226+0000", 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9221000000000003e-05 2024-04-26T12:10:41.069 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:67247 5.0 5:0645b07a:::benchmark_data_smithi045_43640_object67246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.8933316099999997, 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016404439, 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.070 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 67247 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138659+0000", 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138658+0000", 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138777+0000", 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011933400000000001 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138786+0000", 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2730000000000008e-06 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.138792+0000", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.395e-06 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139596+0000", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00080421900000000001 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139718+0000", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121753 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.139879+0000", 2024-04-26T12:10:41.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016133799999999999 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.141900+0000", 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020209730000000001 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.154921+0000", 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013020749999999999 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.155001+0000", 2024-04-26T12:10:41.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9659000000000004e-05 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.155063+0000", 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2513000000000003e-05 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68100 5.d 5:bee81212:::benchmark_data_smithi045_43640_object68099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.4976308969999996, 2024-04-26T12:10:41.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019203250000000002, 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68100 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534394+0000", 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5481999999999997e-05 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534400+0000", 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534404+0000", 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.585e-06 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536672+0000", 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022677349999999999 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536779+0000", 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107212 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536942+0000", 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016312 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.538894+0000", 2024-04-26T12:10:41.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019518739999999999 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553500+0000", 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014605775999999999 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553535+0000", 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5363e-05 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553563+0000", 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7521e-05 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68553 5.8 5:17fa449b:::benchmark_data_smithi045_43640_object68552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.3009471760000002, 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016991656000000001, 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68553 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731043+0000", 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731059+0000", 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.643e-05 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731064+0000", 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8250000000000004e-06 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731067+0000", 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0369999999999999e-06 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735485+0000", 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044181699999999999 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735602+0000", 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117021 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.735700+0000", 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8191999999999998e-05 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741356+0000", 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0056552190000000004 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.747970+0000", 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066147369999999999 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.748002+0000", 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1891999999999999e-05 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.748035+0000", 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2419999999999998e-05 2024-04-26T12:10:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.3004209190000005, 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:41.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:41.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:41.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.300156479, 2024-04-26T12:10:41.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.097 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68566 5.8 5:10f82518:::benchmark_data_smithi045_43640_object68565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.2974723170000004, 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017449837999999999, 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68566 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.098 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734517+0000", 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734594+0000", 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6625000000000006e-05 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734604+0000", 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9229999999999997e-06 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734610+0000", 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.285e-06 2024-04-26T12:10:41.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740147+0000", 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055365650000000002 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740222+0000", 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5360999999999999e-05 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740305+0000", 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3212000000000002e-05 2024-04-26T12:10:41.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741894+0000", 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001588884 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751909+0000", 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010015157 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751936+0000", 2024-04-26T12:10:41.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6497999999999999e-05 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751968+0000", 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2073999999999998e-05 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69126 5.4 5:2bcf67ed:::benchmark_data_smithi045_43640_object69125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.0468019340000003, 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017301426000000002, 2024-04-26T12:10:41.103 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69126 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985187+0000", 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985256+0000", 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8153999999999998e-05 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985266+0000", 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0078000000000001e-05 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985273+0000", 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986297+0000", 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001024196 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986420+0000", 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012266999999999999 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986553+0000", 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013349299999999999 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990054+0000", 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035008769999999999 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002410+0000", 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012356044 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002454+0000", 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4082999999999998e-05 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002490+0000", 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5472000000000002e-05 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69127 5.4 5:2c1dd0bb:::benchmark_data_smithi045_43640_object69126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.0466556560000004, 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017253923000000001, 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69127 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985335+0000", 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985334+0000", 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985384+0000", 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0232000000000003e-05 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985393+0000", 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3000000000000007e-06 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985399+0000", 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7960000000000001e-06 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988415+0000", 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030155550000000001 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988529+0000", 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000114727 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.988675+0000", 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014572899999999999 2024-04-26T12:10:41.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990392+0000", 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017169869999999999 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002528+0000", 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012135633 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002566+0000", 2024-04-26T12:10:41.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8173999999999997e-05 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002589+0000", 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2583e-05 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69380 5.e 5:7fcd3378:::benchmark_data_smithi045_43640_object69379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.9278799280000003, 2024-04-26T12:10:41.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017901108999999998, 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69380 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104141+0000", 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1442000000000002e-05 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104149+0000", 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8599999999999993e-06 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104155+0000", 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106041+0000", 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001886268 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106150+0000", 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109609 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106287+0000", 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.108987+0000", 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026995230000000001 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121935+0000", 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012948406000000001 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121979+0000", 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3568e-05 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.122011+0000", 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2629999999999998e-05 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69739 5.8 5:1a2f062f:::benchmark_data_smithi045_43640_object69738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.7732484270000004, 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016760225, 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69739 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258742+0000", 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258741+0000", 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258840+0000", 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9241999999999996e-05 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258851+0000", 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1144e-05 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.258858+0000", 2024-04-26T12:10:41.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6760000000000001e-06 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265394+0000", 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065353870000000001 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265522+0000", 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012853800000000001 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.265678+0000", 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000156362 2024-04-26T12:10:41.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.273601+0000", 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0079224480000000003 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275386+0000", 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001784716 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275458+0000", 2024-04-26T12:10:41.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2669000000000005e-05 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.275502+0000", 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3778e-05 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.4964021800000005, 2024-04-26T12:10:41.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70404 5.8 5:1adab04b:::benchmark_data_smithi045_43640_object70403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.4752316570000001, 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016676092, 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70404 2024-04-26T12:10:41.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556759+0000", 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556758+0000", 2024-04-26T12:10:41.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556777+0000", 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8961999999999999e-05 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556781+0000", 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.907e-06 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.556786+0000", 2024-04-26T12:10:41.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9309999999999999e-06 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563428+0000", 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066422010000000004 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563504+0000", 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5354999999999999e-05 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.563580+0000", 2024-04-26T12:10:41.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6423999999999999e-05 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.570893+0000", 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073131840000000004 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573311+0000", 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024173860000000001 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573386+0000", 2024-04-26T12:10:41.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5760999999999995e-05 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.573435+0000", 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8374999999999997e-05 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:78400 5.4 5:298bb304:::benchmark_data_smithi045_43640_object78399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.87474350499999998, 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019529787, 2024-04-26T12:10:41.136 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 78400 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157246+0000", 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157288+0000", 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157295+0000", 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157300+0000", 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0989999999999998e-06 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159342+0000", 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020422750000000001 2024-04-26T12:10:41.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159466+0000", 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012425000000000001 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159608+0000", 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141738 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.162201+0000", 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002592652 2024-04-26T12:10:41.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176711+0000", 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014510383999999999 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176744+0000", 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2252999999999998e-05 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176777+0000", 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3024000000000001e-05 2024-04-26T12:10:41.141 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:80052 5.b 5:dd3a38f6:::benchmark_data_smithi045_43640_object80051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.879616+0000", 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.15237403099999999, 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016647523000000001, 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.142 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 80052 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879616+0000", 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879616+0000", 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:41.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879615+0000", 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879679+0000", 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4185999999999998e-05 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879690+0000", 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1156e-05 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879699+0000", 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3809999999999999e-06 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879740+0000", 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.104e-05 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879828+0000", 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8128999999999996e-05 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:41.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.879933+0000", 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000105319 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.882063+0000", 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021298599999999999 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.896170+0000", 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014107066999999999 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:41.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.896222+0000", 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1725999999999999e-05 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.896264+0000", 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1943999999999997e-05 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:41.147 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:41.149 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:41.149 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:41.146+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:41.249 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:41.247+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:41.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:41.344 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:41.344 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:41.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.344 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:81051 5.e e29/17 5:7b6db516:::benchmark_data_smithi045_43640_object81050:head v 29'5124, mlcod=29'5119)", 2024-04-26T12:10:41.344 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.328610+0000", 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0088581849999999993, 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0088822129999999999, 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.328610+0000", 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.328610+0000", 2024-04-26T12:10:41.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.328610+0000", 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.328702+0000", 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1817000000000005e-05 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.328711+0000", 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9420000000000001e-06 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.328722+0000", 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1126e-05 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.331862+0000", 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003140622 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.331879+0000", 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6990000000000002e-05 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81058 5.c 5:3b4b0eb4:::benchmark_data_smithi045_43640_object81057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.329630+0000", 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0078386889999999994, 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.007939537, 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:41.348 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81058 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329630+0000", 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329630+0000", 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329629+0000", 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329654+0000", 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4284e-05 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329661+0000", 2024-04-26T12:10:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329666+0000", 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329706+0000", 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0463999999999997e-05 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329793+0000", 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6248000000000005e-05 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329883+0000", 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0205999999999997e-05 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337244+0000", 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0073610940000000003 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.352 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81059 5.c 5:370cc542:::benchmark_data_smithi045_43640_object81058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.329675+0000", 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0077937780000000003, 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079962490000000004, 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81059 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.353 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329675+0000", 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329675+0000", 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329674+0000", 2024-04-26T12:10:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329699+0000", 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4428000000000001e-05 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329705+0000", 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.212e-06 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.329710+0000", 2024-04-26T12:10:41.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335248+0000", 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055373540000000004 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335371+0000", 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012309500000000001 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335472+0000", 2024-04-26T12:10:41.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010131 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81062 5.6 5:6c899ae3:::benchmark_data_smithi045_43640_object81061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.330651+0000", 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0068177309999999996, 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0071146619999999999, 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.357 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81062 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.330651+0000", 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.330651+0000", 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.330650+0000", 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.330724+0000", 2024-04-26T12:10:41.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4330000000000002e-05 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.330733+0000", 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9090000000000006e-06 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.330739+0000", 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8490000000000002e-06 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.331850+0000", 2024-04-26T12:10:41.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011104940000000001 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.331954+0000", 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104737 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.332049+0000", 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4784999999999995e-05 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:41.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335326+0000", 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0032771340000000001 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81071 5.c 5:3451b4c5:::benchmark_data_smithi045_43640_object81070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.335855+0000", 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001613504, 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020291430000000002, 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.362 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81071 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335855+0000", 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335855+0000", 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335854+0000", 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335911+0000", 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6582999999999997e-05 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335930+0000", 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9236999999999999e-05 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335937+0000", 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9029999999999998e-06 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337280+0000", 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013437830000000001 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337411+0000", 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000130989 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337549+0000", 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013726999999999999 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81072 5.6 5:679a134f:::benchmark_data_smithi045_43640_object81071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.335947+0000", 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001521395, 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020280820000000001, 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:41.366 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81072 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335947+0000", 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335947+0000", 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335947+0000", 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335969+0000", 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2612999999999998e-05 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335977+0000", 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7309999999999993e-06 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.335981+0000", 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0629999999999999e-06 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336010+0000", 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8770000000000001e-05 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336129+0000", 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000119369 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336221+0000", 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1818999999999996e-05 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:81069 5.1 e29/17 5:8d5aee85:::benchmark_data_smithi045_43640_object81068:head v 29'5028, mlcod=29'5026)", 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.336214+0000", 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001254336, 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018422180000000001, 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.370 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336214+0000", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336214+0000", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336214+0000", 2024-04-26T12:10:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336292+0000", 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7940000000000003e-05 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336300+0000", 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6479999999999992e-06 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336307+0000", 2024-04-26T12:10:41.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6730000000000003e-06 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336347+0000", 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.998e-05 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336365+0000", 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8496999999999999e-05 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81075 5.c 5.3455dfbc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.336352+0000", 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0011160549999999999, 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0017628089999999999, 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81075 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336352+0000", 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336352+0000", 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336352+0000", 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336407+0000", 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5268e-05 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336417+0000", 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336424+0000", 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3359999999999997e-06 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81076 5.6 5:6204c4bc:::benchmark_data_smithi045_43640_object81075:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.336439+0000", 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001029907, 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0017454580000000001, 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81076 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336439+0000", 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336439+0000", 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336438+0000", 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336512+0000", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4097999999999994e-05 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336519+0000", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3969999999999999e-06 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.336525+0000", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0220000000000001e-06 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337987+0000", 2024-04-26T12:10:41.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014620919999999999 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338095+0000", 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108731 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81077 5.3 5:c0e088f3:::benchmark_data_smithi045_43640_object81076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.337321+0000", 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000147701, 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00094554199999999995, 2024-04-26T12:10:41.380 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81077 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337321+0000", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337321+0000", 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337320+0000", 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337397+0000", 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6730000000000006e-05 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337405+0000", 2024-04-26T12:10:41.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337412+0000", 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0509999999999999e-06 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337454+0000", 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1491e-05 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337592+0000", 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138391 2024-04-26T12:10:41.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.337777+0000", 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00018515799999999999 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:81078 5.5 5.75b43785 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:41.338186+0000", 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9992824, 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016501299999999999, 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:41.384 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 81078 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338186+0000", 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338186+0000", 2024-04-26T12:10:41.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338186+0000", 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338270+0000", 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4739000000000003e-05 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338280+0000", 2024-04-26T12:10:41.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6010000000000001e-06 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:41.338287+0000", 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 11 2024-04-26T12:10:41.387 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:41.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:41.389 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:41.387+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:41.448 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0: {} 2024-04-26T12:10:41.471 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:41.490 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:41.487+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:41.493 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:10:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:41.590 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:41.589+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:41.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 29 16 81655 81639 175.927 140.062 0.0036966 0.00568102 2024-04-26T12:10:41.622 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:41.623 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:41.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:41.691 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:41.690+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:41.792 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:41.791+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:41.867 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:41.868 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:41.882 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:41.926 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:41.925+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:41.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:10:41.994 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:41.993+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:42.054 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:42.055 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:42.068 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:42.094 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:42.092+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:42.199 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:42.195+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:42.276 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:42.276 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:42.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:42.328 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:42.327+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:42.397 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:42.395+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:42.486 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:42.486 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:42.498 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:42.497+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:42.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:42.599 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:42.597+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:42.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 30 16 83589 83573 174.092 120.875 0.00952735 0.00574048 2024-04-26T12:10:42.689 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:42.690 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:42.701 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:42.700+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:42.705 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:42.747 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:10:42.802 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:42.800+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:42.858 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-26T12:10:42.902 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:42.900+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:42.931 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:42.931 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:42.947 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:42.992 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:10:43.032 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:43.030+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:43.104 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.103+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.174 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:43.175 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:43.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:43.219 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.218+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.303 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:43.303 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:43.306 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.305+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.313 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:43.407 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.406+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.481 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:43.481 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:43.491 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:43.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:43.510 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:43.506+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:43.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 31 16 84417 84401 170.145 51.75 0.00706426 0.00575703 2024-04-26T12:10:43.609 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.608+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.659 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:43.659 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:43.669 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:43.679 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:43.701 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:43.704 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:43.704 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:43.710 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.709+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.802 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:43.802 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:43.802 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 0 2024-04-26T12:10:43.802 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:43.810 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.809+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.812 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:43.912 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:43.911+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:43.939 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:43.940 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:43.940 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:43.940 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:43.940 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:43.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:44.013 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:44.012+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:44.114 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:44.112+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 54.760184973999998, 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017225275000000002, 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.131 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365887+0000", 2024-04-26T12:10:44.132 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365897+0000", 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0438000000000001e-05 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365906+0000", 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.133 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365912+0000", 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366061+0000", 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014978699999999999 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op must wait for map", 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366067+0000", 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.293e-06 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.134 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.377939+0000", 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011872381 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378139+0000", 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020003299999999999 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378286+0000", 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014722300000000001 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381464+0000", 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00317798 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382954+0000", 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00148974 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.382997+0000", 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2988999999999998e-05 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383113+0000", 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011563 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 54.760112636000002, 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017245707999999998, 2024-04-26T12:10:44.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365960+0000", 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.138 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365959+0000", 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365968+0000", 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365977+0000", 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6649999999999998e-06 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.365985+0000", 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366095+0000", 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110449 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.366099+0000", 2024-04-26T12:10:44.140 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378687+0000", 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012587947 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378782+0000", 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5772000000000004e-05 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.378920+0000", 2024-04-26T12:10:44.141 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000137806 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.381973+0000", 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030532939999999998 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383120+0000", 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001146663 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.142 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383166+0000", 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6394999999999999e-05 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:09:49.383205+0000", 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8970999999999997e-05 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:45154 5.5 5:a06af483:::benchmark_data_smithi045_43640_object45153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.143 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.340312173000001, 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016862312000000001, 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 45154 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:44.144 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785760+0000", 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785759+0000", 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785855+0000", 2024-04-26T12:10:44.145 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6248000000000004e-05 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785865+0000", 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2569999999999996e-06 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785872+0000", 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1579999999999999e-06 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.146 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.785914+0000", 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1968000000000002e-05 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786045+0000", 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000131407 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.786145+0000", 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000100283 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.147 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.792782+0000", 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066362549999999998 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802539+0000", 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0097571619999999998 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802585+0000", 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:25.802623+0000", 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7979999999999999e-05 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48681 5.3 5:cb5c3d78:::benchmark_data_smithi045_43640_object48680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.935708969, 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017718434000000002, 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.149 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48681 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190363+0000", 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190440+0000", 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7012000000000001e-05 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190449+0000", 2024-04-26T12:10:44.151 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190458+0000", 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190486+0000", 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8527999999999999e-05 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190600+0000", 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114209 2024-04-26T12:10:44.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.190680+0000", 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9470999999999999e-05 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200074+0000", 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0093940699999999992 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208032+0000", 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079582980000000008 2024-04-26T12:10:44.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208060+0000", 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7807e-05 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208082+0000", 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1764e-05 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48687 5.3 5:cadd13fa:::benchmark_data_smithi045_43640_object48686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.934989836, 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017046892000000001, 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48687 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.155 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191083+0000", 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191082+0000", 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.156 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191139+0000", 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6972999999999998e-05 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191149+0000", 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0672999999999999e-05 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191156+0000", 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192066+0000", 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00090978800000000002 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192160+0000", 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3597000000000005e-05 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.192266+0000", 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000106258 2024-04-26T12:10:44.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200102+0000", 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078359610000000007 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208089+0000", 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0079876530000000008 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208112+0000", 2024-04-26T12:10:44.159 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2662000000000001e-05 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208129+0000", 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7371e-05 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:48688 5.3 5:cfd89793:::benchmark_data_smithi045_43640_object48687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.934860654000001, 2024-04-26T12:10:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016963124999999999, 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 48688 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.161 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191212+0000", 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191211+0000", 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191271+0000", 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0461999999999998e-05 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.162 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191284+0000", 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3037000000000001e-05 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.191292+0000", 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1429999999999998e-06 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193700+0000", 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024080210000000002 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.163 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193836+0000", 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000135747 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.193961+0000", 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000125084 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.200129+0000", 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061672189999999998 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.164 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208138+0000", 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0080092600000000007 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208159+0000", 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0834000000000001e-05 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:27.208175+0000", 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6242000000000001e-05 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.165 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:57462 5.a 5:58ae117f:::benchmark_data_smithi045_43640_object57461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.322387274, 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017784415000000001, 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 57462 2024-04-26T12:10:44.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803684+0000", 2024-04-26T12:10:44.167 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803792+0000", 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108249 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803805+0000", 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2941e-05 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803815+0000", 2024-04-26T12:10:44.168 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810187+0000", 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063728329999999996 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810321+0000", 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000133287 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810470+0000", 2024-04-26T12:10:44.169 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014878800000000001 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.815019+0000", 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045490419999999997 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821390+0000", 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063716229999999999 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.170 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821434+0000", 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4206000000000003e-05 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821470+0000", 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5122e-05 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:59102 5.e e26/17 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head v 26'3740, mlcod=26'3735)", 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:44.171 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.595977867, 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017035195, 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530094+0000", 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530168+0000", 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4119e-05 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530178+0000", 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.530185+0000", 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3999999999999997e-06 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.531272+0000", 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010875049999999999 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.531290+0000", 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7972999999999999e-05 2024-04-26T12:10:44.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.547109+0000", 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015818279000000001 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:31.547130+0000", 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.107e-05 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.175 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67491 5.1 e27/17 5:8916498a:::benchmark_data_smithi045_43640_object67490:head v 27'4186, mlcod=27'4184)", 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8760657030000001, 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016815354000000001, 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.176 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250007+0000", 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250006+0000", 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250771+0000", 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00076450699999999999 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250778+0000", 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3969999999999997e-06 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250785+0000", 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0369999999999997e-06 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250820+0000", 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5237000000000002e-05 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250841+0000", 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0582999999999999e-05 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266774+0000", 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015933251999999998 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266822+0000", 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7877999999999998e-05 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.179 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67493 5.a 5:5e743bfb:::benchmark_data_smithi045_43640_object67492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8752582629999992, 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017457750000000001, 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67493 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.180 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250814+0000", 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250813+0000", 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250842+0000", 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8741000000000001e-05 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250852+0000", 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0703999999999999e-05 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250860+0000", 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5750000000000003e-06 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250902+0000", 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1804999999999997e-05 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251047+0000", 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014501499999999999 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251201+0000", 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015446700000000001 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264294+0000", 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013092922 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.266806+0000", 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025118480000000001 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.268233+0000", 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001427286 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.268272+0000", 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8563000000000003e-05 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.185 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8750973690000006, 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:44.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:44.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67500 5.1 e27/17 5:838173f4:::benchmark_data_smithi045_43640_object67499:head v 27'4188, mlcod=27'4184)", 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8723724530000005, 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016872364000000001, 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253700+0000", 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253699+0000", 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253764+0000", 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4362999999999993e-05 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253772+0000", 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4139999999999994e-06 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.253777+0000", 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6210000000000003e-06 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261979+0000", 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0082025480000000005 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262001+0000", 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1922000000000001e-05 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.270538+0000", 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085369130000000001 2024-04-26T12:10:44.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.270572+0000", 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4097000000000002e-05 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67507 5.2 e27/17 5:443fa10b:::benchmark_data_smithi045_43640_object67506:head v 27'4215, mlcod=27'4213)", 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8701827959999999, 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018353926, 2024-04-26T12:10:44.195 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255889+0000", 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255947+0000", 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8270999999999998e-05 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255957+0000", 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255962+0000", 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7620000000000001e-06 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264264+0000", 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0083020190000000008 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264277+0000", 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274205+0000", 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099278430000000004 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274243+0000", 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8785999999999998e-05 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:70207 5.3 5:c8420e50:::benchmark_data_smithi045_43640_object70206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.199 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:36.464113+0000", 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.6619598609999997, 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017765534999999999, 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 70207 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464113+0000", 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464113+0000", 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464112+0000", 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464223+0000", 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011108900000000001 2024-04-26T12:10:44.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464229+0000", 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464234+0000", 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5730000000000001e-06 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467777+0000", 2024-04-26T12:10:44.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035436339999999999 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467905+0000", 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012747400000000001 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.468039+0000", 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013419899999999999 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.471213+0000", 2024-04-26T12:10:44.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031744680000000002 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481793+0000", 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010580044 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481840+0000", 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6261000000000003e-05 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481878+0000", 2024-04-26T12:10:44.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8438e-05 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:70211 5.c 5:311f3df0:::benchmark_data_smithi045_43640_object70210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.6615520320000003, 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017354991, 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.205 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 70211 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464520+0000", 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464584+0000", 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3862000000000006e-05 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464592+0000", 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9980000000000003e-06 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.464598+0000", 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3999999999999997e-06 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467250+0000", 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026514939999999999 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467373+0000", 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012313800000000001 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.467522+0000", 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149161 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.473308+0000", 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057861029999999999 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481805+0000", 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084968119999999994 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481837+0000", 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2421e-05 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:36.481875+0000", 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8071000000000002e-05 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77464 5.3 5:caff8931:::benchmark_data_smithi045_43640_object77463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:44.210 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.710429+0000", 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.4156437180000001, 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017074038999999999, 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77464 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710429+0000", 2024-04-26T12:10:44.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710429+0000", 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710428+0000", 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710466+0000", 2024-04-26T12:10:44.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7431999999999997e-05 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710472+0000", 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3890000000000002e-06 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.710479+0000", 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5899999999999996e-06 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.713965+0000", 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0034866540000000001 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.714093+0000", 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012799400000000001 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.714271+0000", 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017812000000000001 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.719779+0000", 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055074809999999998 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.727423+0000", 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076445100000000002 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.727468+0000", 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4242000000000001e-05 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.727503+0000", 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5141000000000001e-05 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3207976480000001, 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.216 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:44.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:44.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:44.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.1492940999999997, 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.222 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:44.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:44.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:44.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78258 5.6 5:645888be:::benchmark_data_smithi045_43640_object78257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:40.081812+0000", 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.0442602650000001, 2024-04-26T12:10:44.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017688314, 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78258 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081812+0000", 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081812+0000", 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081811+0000", 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081879+0000", 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7795999999999999e-05 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081887+0000", 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8089999999999993e-06 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.081902+0000", 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4759e-05 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.085920+0000", 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040186830000000003 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.086057+0000", 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013616299999999999 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.086220+0000", 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016353900000000001 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.095847+0000", 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009627254 2024-04-26T12:10:44.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.099406+0000", 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00355844 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.099457+0000", 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0676000000000001e-05 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.099500+0000", 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3860999999999999e-05 2024-04-26T12:10:44.232 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:78400 5.4 e29/17 5:298bb304:::benchmark_data_smithi045_43640_object78399:head v 29'4958, mlcod=29'4955)", 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.9664218959999999, 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016913348000000002, 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:44.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159650+0000", 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:44.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159709+0000", 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8881000000000001e-05 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159716+0000", 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5499999999999997e-06 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159721+0000", 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.578e-06 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:44.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159757+0000", 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5660000000000001e-05 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.159777+0000", 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0018999999999999e-05 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.176534+0000", 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016757625000000002 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:44.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:40.176564+0000", 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9516e-05 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:44.237 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:44.238 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:44.237+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:44.239 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:44.341 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:44.338+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:44.422 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:44.422 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:44.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.422 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85361 5.e 5:7792b0b8:::benchmark_data_smithi045_43640_object85360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.422 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.412628+0000", 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0082301990000000005, 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0082510759999999995, 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85361 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412628+0000", 2024-04-26T12:10:44.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412628+0000", 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412627+0000", 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412670+0000", 2024-04-26T12:10:44.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2462000000000001e-05 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412683+0000", 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.359e-05 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412689+0000", 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.925e-06 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412733+0000", 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3773999999999998e-05 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412852+0000", 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119355 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.412979+0000", 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000126723 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.417128+0000", 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041489209999999999 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85363 5.b 5:d0617067:::benchmark_data_smithi045_43640_object85362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.413354+0000", 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0075046000000000002, 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0075805270000000001, 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85363 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413354+0000", 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413354+0000", 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413353+0000", 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413448+0000", 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4965999999999998e-05 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413456+0000", 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:10:44.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413461+0000", 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413498+0000", 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6884999999999997e-05 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413620+0000", 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121749 2024-04-26T12:10:44.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413767+0000", 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014749300000000001 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.416311+0000", 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0025435810000000001 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85364 5.e 5:719f771b:::benchmark_data_smithi045_43640_object85363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.413468+0000", 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0073904180000000002, 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.007514143, 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85364 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413468+0000", 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413468+0000", 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413468+0000", 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413503+0000", 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5608999999999997e-05 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413508+0000", 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413512+0000", 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5559999999999999e-06 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414869+0000", 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001357254 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.415004+0000", 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013483599999999999 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.415168+0000", 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016394399999999999 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.417395+0000", 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022274370000000001 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85365 5.4 5:268a3058:::benchmark_data_smithi045_43640_object85364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.413516+0000", 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.007342487, 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0075210559999999999, 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.436 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85365 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413516+0000", 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413516+0000", 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413516+0000", 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413557+0000", 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1887000000000001e-05 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413564+0000", 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5300000000000002e-06 2024-04-26T12:10:44.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413567+0000", 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4300000000000002e-06 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413597+0000", 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0083e-05 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413690+0000", 2024-04-26T12:10:44.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2807999999999996e-05 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.413823+0000", 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000132645 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.416620+0000", 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0027968979999999999 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85366 5.8 5:105a7fd5:::benchmark_data_smithi045_43640_object85365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.414219+0000", 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0066392600000000001, 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0069071660000000002, 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85366 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414219+0000", 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414219+0000", 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414219+0000", 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414278+0000", 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9434000000000001e-05 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414286+0000", 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8720000000000002e-06 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414291+0000", 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1050000000000003e-06 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414332+0000", 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1264000000000003e-05 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414472+0000", 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000139548 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.414633+0000", 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000161213 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.416634+0000", 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002001049 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85372 5.d 5:b7eec604:::benchmark_data_smithi045_43640_object85371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.445 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.418343+0000", 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0025149299999999999, 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0028769619999999998, 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85372 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418343+0000", 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418343+0000", 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418343+0000", 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418425+0000", 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2216e-05 2024-04-26T12:10:44.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418433+0000", 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8529999999999992e-06 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418438+0000", 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2870000000000004e-06 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418484+0000", 2024-04-26T12:10:44.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5481e-05 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418635+0000", 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015152199999999999 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85373 5.d 5:bda31fd1:::benchmark_data_smithi045_43640_object85372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.418476+0000", 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.002382243, 2024-04-26T12:10:44.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002825368, 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85373 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418476+0000", 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418476+0000", 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418475+0000", 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418546+0000", 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0819000000000001e-05 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418558+0000", 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1854e-05 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.418565+0000", 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5039999999999996e-06 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.420542+0000", 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019769509999999998 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.420637+0000", 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4939999999999996e-05 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85375 5.0 5:0a2bedcb:::benchmark_data_smithi045_43640_object85374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.419668+0000", 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001190761, 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001681222, 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:44.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85375 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419668+0000", 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419668+0000", 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419667+0000", 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419725+0000", 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8062000000000001e-05 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419735+0000", 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4890000000000001e-06 2024-04-26T12:10:44.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419742+0000", 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6450000000000005e-06 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419779+0000", 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6332999999999999e-05 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.419905+0000", 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012674100000000001 2024-04-26T12:10:44.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.420044+0000", 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013906300000000001 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:85364 5.e e31/17 ondisk, result = 0)", 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.421274+0000", 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9995847, 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012313800000000001, 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.457 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421274+0000", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421274+0000", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421273+0000", 2024-04-26T12:10:44.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421277+0000", 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3689999999999998e-06 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421284+0000", 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0060000000000003e-06 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421289+0000", 2024-04-26T12:10:44.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.04e-06 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421332+0000", 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3823999999999999e-05 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.421340+0000", 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3150000000000003e-06 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.460 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:44.461 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 9 2024-04-26T12:10:44.461 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:44.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:44.463 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:44.460+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:44.563 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:44.562+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:44.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 32 16 85813 85797 167.554 87.25 0.00702416 0.00596465 2024-04-26T12:10:44.665 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:44.663+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:44.685 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:44.685 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:44.685 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:44.685 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:44.685 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:44.698 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:44.765 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:44.763+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:44.866 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:44.864+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.919 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.992384005000002, 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:44.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:44.925 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48066 5.e 5:7af911c1:::benchmark_data_smithi045_43640_object48065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.990092909000001, 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017632022000000001, 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.926 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48066 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925969+0000", 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.925968+0000", 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926028+0000", 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9240999999999997e-05 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926038+0000", 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0658e-05 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.926046+0000", 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3679999999999996e-06 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928423+0000", 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023775649999999999 2024-04-26T12:10:44.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928555+0000", 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131803 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.928694+0000", 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013876599999999999 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930779+0000", 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020856389999999998 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943512+0000", 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012732579000000001 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943564+0000", 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1796999999999999e-05 2024-04-26T12:10:44.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943601+0000", 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7635999999999997e-05 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48685 5.b 5:deb77a5f:::benchmark_data_smithi045_43640_object48684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:44.932 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.725068749999998, 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017384601, 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48685 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.190993+0000", 2024-04-26T12:10:44.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191025+0000", 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2106000000000001e-05 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191031+0000", 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6039999999999998e-06 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191038+0000", 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4529999999999999e-06 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191062+0000", 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4256e-05 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191147+0000", 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4689000000000002e-05 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.191278+0000", 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013082600000000001 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.193322+0000", 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002044438 2024-04-26T12:10:44.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208334+0000", 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015012152000000001 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208359+0000", 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4765000000000001e-05 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:27.208378+0000", 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8978e-05 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:44.939 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.388773644, 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:44.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:44.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68100 5.d 5:bee81212:::benchmark_data_smithi045_43640_object68099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.3817028350000005, 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019203250000000002, 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68100 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.948 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534394+0000", 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5481999999999997e-05 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534400+0000", 2024-04-26T12:10:44.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534404+0000", 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.585e-06 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536672+0000", 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022677349999999999 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536779+0000", 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107212 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536942+0000", 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016312 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.538894+0000", 2024-04-26T12:10:44.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019518739999999999 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553500+0000", 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014605775999999999 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553535+0000", 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5363e-05 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553563+0000", 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7521e-05 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1844928570000004, 2024-04-26T12:10:44.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:44.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:44.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.961 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1842284169999999, 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:44.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68566 5.8 5:10f82518:::benchmark_data_smithi045_43640_object68565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1815442550000004, 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017449837999999999, 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.968 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68566 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734518+0000", 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734517+0000", 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734594+0000", 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6625000000000006e-05 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734604+0000", 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9229999999999997e-06 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.734610+0000", 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.285e-06 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740147+0000", 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055365650000000002 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740222+0000", 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5360999999999999e-05 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.740305+0000", 2024-04-26T12:10:44.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3212000000000002e-05 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741894+0000", 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001588884 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751909+0000", 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010015157 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751936+0000", 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6497999999999999e-05 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751968+0000", 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2073999999999998e-05 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69126 5.4 5:2bcf67ed:::benchmark_data_smithi045_43640_object69125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.9308738719999994, 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017301426000000002, 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69126 2024-04-26T12:10:44.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985188+0000", 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985187+0000", 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985256+0000", 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8153999999999998e-05 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985266+0000", 2024-04-26T12:10:44.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0078000000000001e-05 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.985273+0000", 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986297+0000", 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001024196 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986420+0000", 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012266999999999999 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.986553+0000", 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013349299999999999 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.990054+0000", 2024-04-26T12:10:44.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035008769999999999 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002410+0000", 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012356044 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002454+0000", 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4082999999999998e-05 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.002490+0000", 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5472000000000002e-05 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69380 5.e 5:7fcd3378:::benchmark_data_smithi045_43640_object69379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.8119518659999994, 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017901108999999998, 2024-04-26T12:10:44.981 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69380 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104141+0000", 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1442000000000002e-05 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104149+0000", 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8599999999999993e-06 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104155+0000", 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106041+0000", 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001886268 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106150+0000", 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109609 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106287+0000", 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.108987+0000", 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026995230000000001 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121935+0000", 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012948406000000001 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121979+0000", 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3568e-05 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.122011+0000", 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2629999999999998e-05 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.987 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.3804741180000004, 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.988 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:44.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:78400 5.4 5:298bb304:::benchmark_data_smithi045_43640_object78399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.7588154429999996, 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019529787, 2024-04-26T12:10:44.994 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 78400 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:44.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157246+0000", 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157288+0000", 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157295+0000", 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157300+0000", 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0989999999999998e-06 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159342+0000", 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020422750000000001 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:44.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159466+0000", 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012425000000000001 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159608+0000", 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141738 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.162201+0000", 2024-04-26T12:10:44.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002592652 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176711+0000", 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014510383999999999 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176744+0000", 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2252999999999998e-05 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176777+0000", 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3024000000000001e-05 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84693 5.4 5:246e10ff:::benchmark_data_smithi045_43640_object84692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.126569+0000", 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.78949327300000005, 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017644903999999999, 2024-04-26T12:10:45.001 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84693 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126569+0000", 2024-04-26T12:10:45.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126569+0000", 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126569+0000", 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126662+0000", 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3418000000000006e-05 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126667+0000", 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8879999999999996e-06 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126670+0000", 2024-04-26T12:10:45.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.382e-06 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126698+0000", 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7712000000000002e-05 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126802+0000", 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103588 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.126921+0000", 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119047 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.128726+0000", 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018049299999999999 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.144159+0000", 2024-04-26T12:10:45.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015432991 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.144191+0000", 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2366999999999997e-05 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.144214+0000", 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2952e-05 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.007 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84701 5.4 5:2c13a157:::benchmark_data_smithi045_43640_object84700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.129674+0000", 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.78638834999999996, 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017613302000000001, 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.008 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84701 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129674+0000", 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129674+0000", 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129673+0000", 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129727+0000", 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3597000000000002e-05 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129734+0000", 2024-04-26T12:10:45.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2200000000000003e-06 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129742+0000", 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8199999999999997e-06 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129779+0000", 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7431999999999997e-05 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129896+0000", 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116681 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129978+0000", 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2589000000000005e-05 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132924+0000", 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029459019999999998 2024-04-26T12:10:45.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.147234+0000", 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014309232 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.147265+0000", 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1708999999999997e-05 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.147287+0000", 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1868000000000001e-05 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84702 5.4 5:2f07f7d5:::benchmark_data_smithi045_43640_object84701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.129773+0000", 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.78628962400000002, 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017587864000000002, 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.014 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84702 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129773+0000", 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129773+0000", 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129772+0000", 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129841+0000", 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8893999999999995e-05 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129851+0000", 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0043e-05 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.129858+0000", 2024-04-26T12:10:45.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.131471+0000", 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001612835 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.131551+0000", 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9580999999999996e-05 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.131661+0000", 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109888 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.134769+0000", 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031079760000000001 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.147314+0000", 2024-04-26T12:10:45.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012545908 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.147341+0000", 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6611e-05 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.147360+0000", 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9346000000000001e-05 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.020 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84709 5.4 5:2d763955:::benchmark_data_smithi045_43640_object84708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.132810+0000", 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.78325250099999999, 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018887899, 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84709 2024-04-26T12:10:45.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132810+0000", 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132810+0000", 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132809+0000", 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132936+0000", 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000126515 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132944+0000", 2024-04-26T12:10:45.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9349999999999994e-06 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132950+0000", 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4999999999999996e-06 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132984+0000", 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3695000000000002e-05 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133058+0000", 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4388999999999995e-05 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133152+0000", 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3820999999999995e-05 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.136428+0000", 2024-04-26T12:10:45.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032762490000000002 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151640+0000", 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015211643 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151673+0000", 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3220999999999999e-05 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151698+0000", 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4547999999999999e-05 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84711 5.4 5:232cf151:::benchmark_data_smithi045_43640_object84710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.132959+0000", 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.78310359900000004, 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018824265999999999, 2024-04-26T12:10:45.027 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84711 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132959+0000", 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132959+0000", 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132958+0000", 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133043+0000", 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4889999999999995e-05 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133051+0000", 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0069999999999997e-06 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133057+0000", 2024-04-26T12:10:45.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4420000000000003e-06 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.134795+0000", 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017375789999999999 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.134936+0000", 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014132899999999999 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.135096+0000", 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015927700000000001 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.136673+0000", 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0015775889999999999 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151733+0000", 2024-04-26T12:10:45.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015059499 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151760+0000", 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7368999999999998e-05 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151783+0000", 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2784000000000001e-05 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.033 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85225 5.0 5:04647667:::benchmark_data_smithi045_43640_object85224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.355853+0000", 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.56020916899999995, 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017966569000000002, 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.034 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85225 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355853+0000", 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355853+0000", 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355852+0000", 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355909+0000", 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6860000000000001e-05 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355916+0000", 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7170000000000002e-06 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355921+0000", 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9110000000000001e-06 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.360538+0000", 2024-04-26T12:10:45.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0046166619999999997 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.360656+0000", 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000118755 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.360814+0000", 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015728000000000001 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367576+0000", 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067621859999999999 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373738+0000", 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061621360000000003 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373783+0000", 2024-04-26T12:10:45.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5207000000000003e-05 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373820+0000", 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6439999999999997e-05 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85226 5.0 5:0ac40494:::benchmark_data_smithi045_43640_object85225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.356110+0000", 2024-04-26T12:10:45.040 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.55995202799999999, 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017798329000000002, 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85226 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.356110+0000", 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.356110+0000", 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.356110+0000", 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.356190+0000", 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0130999999999996e-05 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.356198+0000", 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8229999999999995e-06 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.356202+0000", 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2270000000000004e-06 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363105+0000", 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0069028650000000002 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363223+0000", 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011804 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363356+0000", 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000133244 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.371589+0000", 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0082333809999999997 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373834+0000", 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002244865 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373875+0000", 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1084999999999997e-05 2024-04-26T12:10:45.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373909+0000", 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3191000000000001e-05 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85247 5.8 5:15f834de:::benchmark_data_smithi045_43640_object85246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.363216+0000", 2024-04-26T12:10:45.047 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.55284645600000004, 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017890646999999999, 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85247 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:45.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363216+0000", 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363216+0000", 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363215+0000", 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363261+0000", 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5713000000000001e-05 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363269+0000", 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3680000000000002e-06 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363277+0000", 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2150000000000004e-06 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367695+0000", 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044179919999999999 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:45.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367808+0000", 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011369799999999999 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367953+0000", 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000144895 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381021+0000", 2024-04-26T12:10:45.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013067725000000001 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381062+0000", 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1588999999999998e-05 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381087+0000", 2024-04-26T12:10:45.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4664999999999998e-05 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381106+0000", 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9310999999999999e-05 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:45.054 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:45.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:10:45.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:45.057 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:45.055+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:45.157 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.155+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87289 5.2 5:41d11c1a:::benchmark_data_smithi045_43640_object87288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242701+0000", 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.005586906, 2024-04-26T12:10:45.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056129860000000004, 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87289 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242701+0000", 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242701+0000", 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242701+0000", 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242774+0000", 2024-04-26T12:10:45.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3319999999999996e-05 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242786+0000", 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2374999999999999e-05 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242802+0000", 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6112000000000001e-05 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242930+0000", 2024-04-26T12:10:45.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012760500000000001 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243044+0000", 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011369100000000001 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87290 5.5 5:aff79676:::benchmark_data_smithi045_43640_object87289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0054703240000000004, 2024-04-26T12:10:45.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055494890000000003, 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87290 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242817+0000", 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242857+0000", 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0182000000000003e-05 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242867+0000", 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.414e-06 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242874+0000", 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9659999999999999e-06 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247153+0000", 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042792749999999999 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247267+0000", 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011362300000000001 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87293 5.3 5:c8b6dee1:::benchmark_data_smithi045_43640_object87292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.243018+0000", 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0052704850000000001, 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053932370000000004, 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.258 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87293 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243018+0000", 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243018+0000", 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243017+0000", 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243082+0000", 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4775000000000002e-05 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243092+0000", 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.028e-05 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.243099+0000", 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3150000000000003e-06 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244933+0000", 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018333360000000001 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245043+0000", 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110343 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.261 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87286 5.e e31/17 5:768e3130:::benchmark_data_smithi045_43640_object87285:head v 31'5470, mlcod=31'5467)", 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.244631+0000", 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036577179999999999, 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038203070000000002, 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244631+0000", 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244631+0000", 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244630+0000", 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244701+0000", 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0635000000000004e-05 2024-04-26T12:10:45.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244709+0000", 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3809999999999999e-06 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244717+0000", 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8250000000000005e-06 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244761+0000", 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4344000000000001e-05 2024-04-26T12:10:45.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.244774+0000", 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2935000000000001e-05 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87296 5.5 5.aec7f2c5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.245237+0000", 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0030511969999999999, 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0032503689999999999, 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.265 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87296 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245237+0000", 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245237+0000", 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245236+0000", 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245351+0000", 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114635 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245362+0000", 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0849000000000001e-05 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245369+0000", 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6410000000000002e-06 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87294 5.8 e31/17 5:1accd58d:::benchmark_data_smithi045_43640_object87293:head v 31'5331, mlcod=31'5329)", 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.245248+0000", 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0030404289999999999, 2024-04-26T12:10:45.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003282428, 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245248+0000", 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245248+0000", 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245247+0000", 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245368+0000", 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120606 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245378+0000", 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0293e-05 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245385+0000", 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1350000000000003e-06 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245420+0000", 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4601000000000003e-05 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245437+0000", 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7207e-05 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87297 5.7 5:ead1396f:::benchmark_data_smithi045_43640_object87296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.245377+0000", 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029117639999999998, 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031930439999999999, 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87297 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.272 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245377+0000", 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245377+0000", 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245376+0000", 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245410+0000", 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3905999999999997e-05 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245417+0000", 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.114e-06 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245423+0000", 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4779999999999999e-06 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245465+0000", 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2759000000000002e-05 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245605+0000", 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139355 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87299 5.c 5:3e71807a:::benchmark_data_smithi045_43640_object87298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.275 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.245434+0000", 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0028541259999999998, 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031768569999999999, 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87299 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245434+0000", 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245434+0000", 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245434+0000", 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245462+0000", 2024-04-26T12:10:45.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8172000000000001e-05 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245469+0000", 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245474+0000", 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1089999999999997e-06 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245519+0000", 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4802000000000002e-05 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.245636+0000", 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011729 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87300 5.2 5:4aabe721:::benchmark_data_smithi045_43640_object87299:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.247021+0000", 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001267303, 2024-04-26T12:10:45.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001631525, 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87300 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247021+0000", 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247021+0000", 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247020+0000", 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247079+0000", 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9011000000000001e-05 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247089+0000", 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0444e-05 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247097+0000", 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247140+0000", 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2585e-05 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247220+0000", 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0643999999999996e-05 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87301 5.7 5:e2acbaba:::benchmark_data_smithi045_43640_object87300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.247109+0000", 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0011796319999999999, 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016569989999999999, 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.283 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87301 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247109+0000", 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247109+0000", 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247108+0000", 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247139+0000", 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.078e-05 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247146+0000", 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3289999999999996e-06 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247152+0000", 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3709999999999999e-06 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247751+0000", 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00059884399999999996 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247852+0000", 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000101548 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87295 5.0 e31/17 5:0456c79b:::benchmark_data_smithi045_43640_object87294:head v 31'5488, mlcod=31'5485)", 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.247739+0000", 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00054925500000000001, 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010761690000000001, 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247739+0000", 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247739+0000", 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247738+0000", 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247782+0000", 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3401e-05 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247791+0000", 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4790000000000002e-06 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247798+0000", 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247832+0000", 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3433999999999999e-05 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247850+0000", 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8224e-05 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87298 5.b e31/17 5:dc15ee5e:::benchmark_data_smithi045_43640_object87297:head v 31'5314, mlcod=31'5312)", 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.247811+0000", 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00047696499999999998, 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00103824, 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.290 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247811+0000", 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247811+0000", 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247811+0000", 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247841+0000", 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.044e-05 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247848+0000", 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0430000000000002e-06 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247853+0000", 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8180000000000003e-06 2024-04-26T12:10:45.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247885+0000", 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1711000000000002e-05 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247904+0000", 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8689999999999999e-05 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87303 5.b e31/17)", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.248678+0000", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9996099, 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000202797, 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.248678+0000", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.248678+0000", 2024-04-26T12:10:45.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.248678+0000", 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.248722+0000", 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3809e-05 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.248732+0000", 2024-04-26T12:10:45.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0006e-05 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.248739+0000", 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8480000000000003e-06 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87281 5.5 5:adf3e7b9:::benchmark_data_smithi045_43640_object87280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0077888080000000004, 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084133330000000003, 2024-04-26T12:10:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87281 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240499+0000", 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240554+0000", 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4605999999999999e-05 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240559+0000", 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2499999999999997e-06 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240562+0000", 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6449999999999998e-06 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240606+0000", 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3628000000000003e-05 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240733+0000", 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012648 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87285 5.5 5:ae4a828d:::benchmark_data_smithi045_43640_object87284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0060833220000000004, 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067477860000000004, 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.300 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87285 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242204+0000", 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242283+0000", 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242290+0000", 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242296+0000", 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6189999999999999e-06 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242689+0000", 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00039278799999999998 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242837+0000", 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000148586 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.304 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:45.304 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 15 2024-04-26T12:10:45.304 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:45.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:45.305 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.303+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:45.406 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.404+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:45.508 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.506+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:45.541 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:45.541 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:45.541 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:45.541 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:45.542 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:45.550 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:45.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 33 16 88053 88037 166.719 140 0.0129676 0.00599444 2024-04-26T12:10:45.634 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.632+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:45.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:45.708 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.706+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:57462 5.a 5:58ae117f:::benchmark_data_smithi045_43640_object57461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:45.782 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.971379366000001, 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017784415000000001, 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 57462 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803685+0000", 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803684+0000", 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803792+0000", 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108249 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803805+0000", 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2941e-05 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.803815+0000", 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810187+0000", 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063728329999999996 2024-04-26T12:10:45.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810321+0000", 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000133287 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.810470+0000", 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014878800000000001 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.815019+0000", 2024-04-26T12:10:45.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045490419999999997 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821390+0000", 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063716229999999999 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821434+0000", 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4206000000000003e-05 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:30.821470+0000", 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5122e-05 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.524089460999999, 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.788 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67507 5.2 e27/17 5:443fa10b:::benchmark_data_smithi045_43640_object67506:head v 27'4215, mlcod=27'4213)", 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.519174888, 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018353926, 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255889+0000", 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255947+0000", 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8270999999999998e-05 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255957+0000", 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255962+0000", 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7620000000000001e-06 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264264+0000", 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0083020190000000008 2024-04-26T12:10:45.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264277+0000", 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274205+0000", 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099278430000000004 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274243+0000", 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8785999999999998e-05 2024-04-26T12:10:45.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.9697897399999995, 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.798 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:45.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.804 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:45.804 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:45.804 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.798286192, 2024-04-26T12:10:45.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:45.804 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:84462 5.2 5:432b311c:::benchmark_data_smithi045_43640_object84461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.020882+0000", 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.75418264, 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018209982999999999, 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.810 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 84462 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020882+0000", 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020882+0000", 2024-04-26T12:10:45.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020881+0000", 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020909+0000", 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7973000000000001e-05 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020916+0000", 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1620000000000002e-06 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020922+0000", 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.049e-06 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.023465+0000", 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025427330000000001 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.023607+0000", 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014225699999999999 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.038980+0000", 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015372228999999999 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039021+0000", 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1103000000000003e-05 2024-04-26T12:10:45.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039092+0000", 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1081000000000006e-05 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:84467 5.2 5:4297f6aa:::benchmark_data_smithi045_43640_object84466:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.021296+0000", 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.7537686379999999, 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01795165, 2024-04-26T12:10:45.815 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 84467 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021296+0000", 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021296+0000", 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021295+0000", 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021330+0000", 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4622000000000002e-05 2024-04-26T12:10:45.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021337+0000", 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2359999999999998e-06 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021344+0000", 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9750000000000001e-06 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.027986+0000", 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066416670000000004 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.028123+0000", 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013772900000000001 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039101+0000", 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010977351 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039158+0000", 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6821999999999999e-05 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039247+0000", 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9838000000000003e-05 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:84710 5.c 5:3ee24203:::benchmark_data_smithi045_43640_object84709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.820 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.6421660679999999, 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018648056, 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 84710 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:45.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132997+0000", 2024-04-26T12:10:45.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9498000000000002e-05 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133004+0000", 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7599999999999997e-06 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133008+0000", 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1869999999999999e-06 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.141439+0000", 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084310070000000008 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.141532+0000", 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2349999999999995e-05 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151468+0000", 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099362340000000004 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151502+0000", 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4464000000000001e-05 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151546+0000", 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4098999999999999e-05 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:84709 5.4 e31/17 5:2d763955:::benchmark_data_smithi045_43640_object84708:head v 31'5345, mlcod=31'5340)", 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:45.825 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.6418723850000001, 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018267546999999999, 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:45.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133243+0000", 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1291000000000001e-05 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133249+0000", 2024-04-26T12:10:45.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133254+0000", 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4159999999999997e-06 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.138517+0000", 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005263045 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.138540+0000", 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3175000000000001e-05 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151435+0000", 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012895138 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151460+0000", 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4626000000000001e-05 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87281 5.5 5:adf3e7b9:::benchmark_data_smithi045_43640_object87280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.53456494300000001, 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018066901999999999, 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87281 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.830 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240499+0000", 2024-04-26T12:10:45.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240554+0000", 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4605999999999999e-05 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240559+0000", 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2499999999999997e-06 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240562+0000", 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6449999999999998e-06 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240606+0000", 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3628000000000003e-05 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240733+0000", 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012648 2024-04-26T12:10:45.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.258467+0000", 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017734295000000001 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.258500+0000", 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3569000000000003e-05 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.258566+0000", 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6019999999999995e-05 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87285 5.5 5:ae4a828d:::benchmark_data_smithi045_43640_object87284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.53285945700000004, 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018608099999999999, 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.835 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87285 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242204+0000", 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242283+0000", 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242290+0000", 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:10:45.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242296+0000", 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6189999999999999e-06 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242689+0000", 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00039278799999999998 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242837+0000", 2024-04-26T12:10:45.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000148586 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260672+0000", 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017835047999999999 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260725+0000", 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2094e-05 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260813+0000", 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8570000000000001e-05 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87290 5.5 5:aff79676:::benchmark_data_smithi045_43640_object87289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.53224645900000001, 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018117724000000002, 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.840 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87290 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:45.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242817+0000", 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242857+0000", 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0182000000000003e-05 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242867+0000", 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.414e-06 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242874+0000", 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9659999999999999e-06 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247153+0000", 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042792749999999999 2024-04-26T12:10:45.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247267+0000", 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011362300000000001 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260822+0000", 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013555671 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260866+0000", 2024-04-26T12:10:45.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3684999999999999e-05 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260936+0000", 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9667999999999998e-05 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.30709716100000001, 2024-04-26T12:10:45.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:45.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87777 5.4 e31/17 5:23e67be4:::benchmark_data_smithi045_43640_object87776:head v 31'5544, mlcod=31'5542)", 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.468504+0000", 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.30656045300000001, 2024-04-26T12:10:45.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017911089000000002, 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468504+0000", 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468504+0000", 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468504+0000", 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468562+0000", 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7877999999999997e-05 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468566+0000", 2024-04-26T12:10:45.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6709999999999998e-06 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468569+0000", 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1130000000000001e-06 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469891+0000", 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013219810000000001 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469908+0000", 2024-04-26T12:10:45.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7093999999999999e-05 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.486375+0000", 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016466624999999999 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.486415+0000", 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0009999999999998e-05 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.30474578499999999, 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.858 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.303102914, 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:45.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:45.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87786 5.4 e31/17 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head v 31'5547, mlcod=31'5542)", 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.301306289, 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019118006999999999, 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.863 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473757+0000", 2024-04-26T12:10:45.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473824+0000", 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6338000000000001e-05 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473836+0000", 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473843+0000", 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480070+0000", 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062268760000000001 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480092+0000", 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2546000000000001e-05 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492858+0000", 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012765914 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492876+0000", 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8051e-05 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87790 5.c 5:3645b4fc:::benchmark_data_smithi045_43640_object87789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.475164+0000", 2024-04-26T12:10:45.867 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.29989997400000001, 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017875149, 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87790 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475164+0000", 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475164+0000", 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475164+0000", 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475218+0000", 2024-04-26T12:10:45.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4583999999999998e-05 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475228+0000", 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6940000000000007e-06 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475235+0000", 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8460000000000002e-06 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.486408+0000", 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011173091 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.486555+0000", 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000147334 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492928+0000", 2024-04-26T12:10:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006372834 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492971+0000", 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3170000000000002e-05 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.493040+0000", 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8298000000000002e-05 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:88303 5.a 5:56ab7b61:::benchmark_data_smithi045_43640_object88302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.051465027000000003, 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019532260999999999, 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 88303 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723634+0000", 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5278999999999999e-05 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723641+0000", 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723647+0000", 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733456+0000", 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098080170000000005 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733578+0000", 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122633 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733728+0000", 2024-04-26T12:10:45.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149684 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.735926+0000", 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021982989999999999 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743048+0000", 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0071219910000000003 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743094+0000", 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5781000000000001e-05 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743132+0000", 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7795e-05 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:88307 5.a 5:5f0a938d:::benchmark_data_smithi045_43640_object88306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.724896+0000", 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.050168855999999998, 2024-04-26T12:10:45.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018288839000000001, 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 88307 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724896+0000", 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724896+0000", 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724895+0000", 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724965+0000", 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9762000000000001e-05 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724976+0000", 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1790000000000001e-05 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724984+0000", 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.96e-06 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.735966+0000", 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010982063 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.736101+0000", 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013508699999999999 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.736222+0000", 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120622 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.740476+0000", 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042536830000000003 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743140+0000", 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026637840000000002 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743165+0000", 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5273e-05 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743184+0000", 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9667e-05 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:45.884 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:45.884 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:45.885 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:45.884+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:45.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:45.902 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:45.902 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:45.902 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:45.904 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:45.905 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:45.988 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:45.986+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:10:46.070 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:46.071 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:46.086 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:46.087 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:46.086+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:46.189 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:46.186+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.261 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:46.261 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:46.277 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:46.289 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:46.287+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.390 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:46.388+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.456 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:46.456 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:46.473 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:46.491 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:46.490+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:46.593 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:46.591+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 34 16 90376 90360 166.085 145.188 0.00591888 0.00601738 2024-04-26T12:10:46.664 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:46.664 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:46.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:46.720 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:46.718+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.794 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:46.792+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:46.859 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:10:46.895 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:46.894+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:46.906 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:46.906 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:46.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:46.970 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-26T12:10:46.996 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:46.995+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.097 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:47.096+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.154 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:47.154 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:47.169 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:47.216 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:47.215+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.298 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:47.297+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.336 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:47.336 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:47.352 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:47.400 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:47.398+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:47.502 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:47.501+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.573 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:47.573 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:47.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:47.602 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:47.600+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:47.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 35 16 92656 92640 165.411 142.5 0.00312307 0.0060421 2024-04-26T12:10:47.702 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:47.700+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:47.803 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:47.802+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.808 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:47.808 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:47.825 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:47.905 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:47.904+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:47.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:48.013 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:48.008+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:48.015 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:48.016 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:48.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:10:48.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:48.092 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:48.106 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:48.105+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:48.115 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:48.118 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:48.118 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:48.207 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:48.206+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:48.265 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:48.265 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:48.265 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:48.265 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:48.266 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:48.282 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:48.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T12:10:48.326 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:48.324+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:48.409 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:48.406+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:48.479 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.225143456, 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:48.480 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.481 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:48.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:67507 5.2 e27/17 5:443fa10b:::benchmark_data_smithi045_43640_object67506:head v 27'4215, mlcod=27'4213)", 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.220228883000001, 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018353926, 2024-04-26T12:10:48.485 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255890+0000", 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255889+0000", 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255947+0000", 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8270999999999998e-05 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255957+0000", 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:10:48.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.255962+0000", 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7620000000000001e-06 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264264+0000", 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0083020190000000008 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264277+0000", 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274205+0000", 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099278430000000004 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.274243+0000", 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8785999999999998e-05 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.489 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.6708437350000001, 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.490 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:48.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:48.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:48.495 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.4993401869999996, 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:48.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:48.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:48.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:84462 5.2 5:432b311c:::benchmark_data_smithi045_43640_object84461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.020882+0000", 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.4552366350000003, 2024-04-26T12:10:48.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018209982999999999, 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 84462 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020882+0000", 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020882+0000", 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020881+0000", 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020909+0000", 2024-04-26T12:10:48.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7973000000000001e-05 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020916+0000", 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1620000000000002e-06 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.020922+0000", 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.049e-06 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.023465+0000", 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025427330000000001 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.023607+0000", 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014225699999999999 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.038980+0000", 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015372228999999999 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039021+0000", 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1103000000000003e-05 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039092+0000", 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1081000000000006e-05 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:84467 5.2 5:4297f6aa:::benchmark_data_smithi045_43640_object84466:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.021296+0000", 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.454822633, 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01795165, 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 84467 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021296+0000", 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021296+0000", 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021295+0000", 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021330+0000", 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4622000000000002e-05 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021337+0000", 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2359999999999998e-06 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.021344+0000", 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9750000000000001e-06 2024-04-26T12:10:48.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.027986+0000", 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066416670000000004 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.028123+0000", 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013772900000000001 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039101+0000", 2024-04-26T12:10:48.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010977351 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039158+0000", 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6821999999999999e-05 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.039247+0000", 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9838000000000003e-05 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:84710 5.c 5:3ee24203:::benchmark_data_smithi045_43640_object84709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3432200630000004, 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018648056, 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 84710 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.512 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132898+0000", 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.132997+0000", 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9498000000000002e-05 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133004+0000", 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7599999999999997e-06 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133008+0000", 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1869999999999999e-06 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.141439+0000", 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084310070000000008 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.141532+0000", 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2349999999999995e-05 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151468+0000", 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099362340000000004 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151502+0000", 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4464000000000001e-05 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151546+0000", 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4098999999999999e-05 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.516 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:84709 5.4 e31/17 5:2d763955:::benchmark_data_smithi045_43640_object84708:head v 31'5345, mlcod=31'5340)", 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3429263799999998, 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018267546999999999, 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:48.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133192+0000", 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133243+0000", 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1291000000000001e-05 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133249+0000", 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.133254+0000", 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4159999999999997e-06 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.138517+0000", 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005263045 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.138540+0000", 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3175000000000001e-05 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151435+0000", 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012895138 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:44.151460+0000", 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4626000000000001e-05 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87281 5.5 5:adf3e7b9:::benchmark_data_smithi045_43640_object87280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.235618938, 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018066901999999999, 2024-04-26T12:10:48.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87281 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240500+0000", 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240499+0000", 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240554+0000", 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4605999999999999e-05 2024-04-26T12:10:48.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240559+0000", 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2499999999999997e-06 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240562+0000", 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6449999999999998e-06 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240606+0000", 2024-04-26T12:10:48.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3628000000000003e-05 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.240733+0000", 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012648 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.258467+0000", 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017734295000000001 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.258500+0000", 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3569000000000003e-05 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.258566+0000", 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6019999999999995e-05 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87285 5.5 5:ae4a828d:::benchmark_data_smithi045_43640_object87284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:48.526 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2339134519999999, 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018608099999999999, 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87285 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242205+0000", 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242204+0000", 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242283+0000", 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:10:48.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242290+0000", 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2810000000000003e-06 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242296+0000", 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6189999999999999e-06 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242689+0000", 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00039278799999999998 2024-04-26T12:10:48.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242837+0000", 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000148586 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260672+0000", 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017835047999999999 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260725+0000", 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2094e-05 2024-04-26T12:10:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260813+0000", 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8570000000000001e-05 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87290 5.5 5:aff79676:::benchmark_data_smithi045_43640_object87289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2333004540000001, 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018117724000000002, 2024-04-26T12:10:48.531 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87290 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242818+0000", 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242817+0000", 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242857+0000", 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0182000000000003e-05 2024-04-26T12:10:48.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242867+0000", 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.414e-06 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.242874+0000", 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9659999999999999e-06 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247153+0000", 2024-04-26T12:10:48.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042792749999999999 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.247267+0000", 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011362300000000001 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260822+0000", 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013555671 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260866+0000", 2024-04-26T12:10:48.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3684999999999999e-05 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.260936+0000", 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9667999999999998e-05 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.0081511559999998, 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:48.536 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:48.541 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.0057997799999998, 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.0041569090000002, 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.546 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:48.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:48.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:48.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87786 5.4 e31/17 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head v 31'5547, mlcod=31'5542)", 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:48.550 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.0023602839999999, 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019118006999999999, 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473757+0000", 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473824+0000", 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6338000000000001e-05 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473836+0000", 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:48.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473843+0000", 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480070+0000", 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062268760000000001 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480092+0000", 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2546000000000001e-05 2024-04-26T12:10:48.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492858+0000", 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012765914 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492876+0000", 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8051e-05 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:88303 5.a 5:56ab7b61:::benchmark_data_smithi045_43640_object88302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.752519022, 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019532260999999999, 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 88303 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.555 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723634+0000", 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5278999999999999e-05 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723641+0000", 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723647+0000", 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:10:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733456+0000", 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098080170000000005 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733578+0000", 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122633 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733728+0000", 2024-04-26T12:10:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149684 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.735926+0000", 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021982989999999999 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743048+0000", 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0071219910000000003 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743094+0000", 2024-04-26T12:10:48.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5781000000000001e-05 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743132+0000", 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7795e-05 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:88307 5.a 5:5f0a938d:::benchmark_data_smithi045_43640_object88306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.724896+0000", 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.7512228510000001, 2024-04-26T12:10:48.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018288839000000001, 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 88307 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724896+0000", 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724896+0000", 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724895+0000", 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724965+0000", 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9762000000000001e-05 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724976+0000", 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1790000000000001e-05 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.724984+0000", 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.96e-06 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.735966+0000", 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010982063 2024-04-26T12:10:48.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.736101+0000", 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013508699999999999 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.736222+0000", 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120622 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.740476+0000", 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042536830000000003 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743140+0000", 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026637840000000002 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743165+0000", 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5273e-05 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743184+0000", 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9667e-05 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.26978226900000002, 2024-04-26T12:10:48.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:10:48.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:10:48.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:10:48.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.26944300300000001, 2024-04-26T12:10:48.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:10:48.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:10:48.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:94003 5.1 5:8129722c:::benchmark_data_smithi045_43640_object94002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.26355020699999998, 2024-04-26T12:10:48.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018903178999999999, 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 94003 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212567+0000", 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212594+0000", 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6463999999999999e-05 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212606+0000", 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2283000000000001e-05 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212614+0000", 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.220138+0000", 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0075244329999999996 2024-04-26T12:10:48.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.220265+0000", 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012707800000000001 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231382+0000", 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011116892999999999 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231426+0000", 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3520999999999999e-05 2024-04-26T12:10:48.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231471+0000", 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5738999999999997e-05 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:48.581 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:48.583 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:48.583 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:48.581+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:48.606 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 36 16 94872 94856 164.663 138.5 0.00364023 0.00606952 2024-04-26T12:10:48.683 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:48.682+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:95232 5.0 5:0ec03c36:::benchmark_data_smithi045_43640_object95231:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:48.757365+0000", 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0031142119999999999, 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031339179999999999, 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:48.761 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 95232 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757365+0000", 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:48.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757365+0000", 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757364+0000", 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757400+0000", 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5818999999999997e-05 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757407+0000", 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1890000000000001e-06 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757414+0000", 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8399999999999997e-06 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.759157+0000", 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017432649999999999 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.759256+0000", 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8628000000000005e-05 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.759354+0000", 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7878e-05 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.765 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:95225 5.0 5:0976f9f8:::benchmark_data_smithi045_43640_object95224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:48.756672+0000", 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0038064790000000002, 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0038768549999999998, 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 95225 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:48.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756672+0000", 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756672+0000", 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756672+0000", 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756801+0000", 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012925400000000001 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756809+0000", 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8590000000000005e-06 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756814+0000", 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9640000000000002e-06 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756851+0000", 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7518999999999998e-05 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.756956+0000", 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104656 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:48.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757046+0000", 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0168999999999997e-05 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:95228 5.e 5:72416b36:::benchmark_data_smithi045_43640_object95227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:48.757099+0000", 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0033794620000000002, 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034932399999999999, 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:48.770 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 95228 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757099+0000", 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757099+0000", 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:48.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757099+0000", 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757201+0000", 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102128 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757210+0000", 2024-04-26T12:10:48.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3470000000000005e-06 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757216+0000", 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4879999999999998e-06 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757257+0000", 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1060999999999999e-05 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:48.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757368+0000", 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111167 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.757484+0000", 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116413 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:48.759555+0000", 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002070513 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:48.774 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.775 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:48.775 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:48.775 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 3 2024-04-26T12:10:48.775 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:48.777 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:48.818 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:48.817+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:48.886 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:48.883+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:48.989 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:48.986+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:48.998 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:48.999 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:48.999 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:48.999 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:48.999 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:49.013 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:10:49.100 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.099+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:49.187 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.186+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.317417268, 2024-04-26T12:10:49.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:49.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.248 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:49.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:49.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.713806906999999, 2024-04-26T12:10:49.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:49.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:49.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:49.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:49.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68100 5.d 5:bee81212:::benchmark_data_smithi045_43640_object68099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:49.262 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.706736098, 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019203250000000002, 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68100 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.263 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534394+0000", 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5481999999999997e-05 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534400+0000", 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534404+0000", 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.585e-06 2024-04-26T12:10:49.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536672+0000", 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022677349999999999 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.268 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536779+0000", 2024-04-26T12:10:49.268 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107212 2024-04-26T12:10:49.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.268 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.268 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:49.268 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536942+0000", 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016312 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.538894+0000", 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019518739999999999 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553500+0000", 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014605775999999999 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553535+0000", 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5363e-05 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553563+0000", 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7521e-05 2024-04-26T12:10:49.270 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.50952612, 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.271 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:49.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.276 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.50926168, 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.277 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:49.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:49.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:49.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:49.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:69380 5.e 5:7fcd3378:::benchmark_data_smithi045_43640_object69379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:49.282 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.136985128999999, 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017901108999999998, 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 69380 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104110+0000", 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104141+0000", 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1442000000000002e-05 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104149+0000", 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8599999999999993e-06 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.104155+0000", 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.285 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106041+0000", 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001886268 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106150+0000", 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109609 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.106287+0000", 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.108987+0000", 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026995230000000001 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121935+0000", 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012948406000000001 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.121979+0000", 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3568e-05 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.122011+0000", 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2629999999999998e-05 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.705507381, 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.288 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:49.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:49.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:49.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:78400 5.4 5:298bb304:::benchmark_data_smithi045_43640_object78399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.0838487059999995, 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019529787, 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 78400 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157246+0000", 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157288+0000", 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157295+0000", 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157300+0000", 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0989999999999998e-06 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159342+0000", 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020422750000000001 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159466+0000", 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012425000000000001 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159608+0000", 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141738 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.162201+0000", 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002592652 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176711+0000", 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014510383999999999 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176744+0000", 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2252999999999998e-05 2024-04-26T12:10:49.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176777+0000", 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3024000000000001e-05 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84709 5.4 5:2d763955:::benchmark_data_smithi045_43640_object84708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.132810+0000", 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.1082857639999997, 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018887899, 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.299 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84709 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132810+0000", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132810+0000", 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132809+0000", 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132936+0000", 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000126515 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132944+0000", 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9349999999999994e-06 2024-04-26T12:10:49.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132950+0000", 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4999999999999996e-06 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132984+0000", 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3695000000000002e-05 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133058+0000", 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4388999999999995e-05 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133152+0000", 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3820999999999995e-05 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.136428+0000", 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032762490000000002 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151640+0000", 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015211643 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151673+0000", 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3220999999999999e-05 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151698+0000", 2024-04-26T12:10:49.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4547999999999999e-05 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:84711 5.4 5:232cf151:::benchmark_data_smithi045_43640_object84710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.132959+0000", 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.1081368620000003, 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018824265999999999, 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.305 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 84711 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132959+0000", 2024-04-26T12:10:49.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132959+0000", 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.132958+0000", 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133043+0000", 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4889999999999995e-05 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133051+0000", 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0069999999999997e-06 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.133057+0000", 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4420000000000003e-06 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.134795+0000", 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017375789999999999 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.134936+0000", 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014132899999999999 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.135096+0000", 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015927700000000001 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.136673+0000", 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0015775889999999999 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151733+0000", 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015059499 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151760+0000", 2024-04-26T12:10:49.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7368999999999998e-05 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.151783+0000", 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2784000000000001e-05 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85225 5.0 5:04647667:::benchmark_data_smithi045_43640_object85224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.355853+0000", 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.8852424320000001, 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017966569000000002, 2024-04-26T12:10:49.311 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85225 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355853+0000", 2024-04-26T12:10:49.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355853+0000", 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355852+0000", 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355909+0000", 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6860000000000001e-05 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355916+0000", 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7170000000000002e-06 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.355921+0000", 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9110000000000001e-06 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.360538+0000", 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0046166619999999997 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.360656+0000", 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000118755 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.360814+0000", 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015728000000000001 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367576+0000", 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067621859999999999 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373738+0000", 2024-04-26T12:10:49.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061621360000000003 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373783+0000", 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5207000000000003e-05 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.373820+0000", 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6439999999999997e-05 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:85247 5.8 5:15f834de:::benchmark_data_smithi045_43640_object85246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:44.363216+0000", 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.8778797190000001, 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017890646999999999, 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 85247 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363216+0000", 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363216+0000", 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363215+0000", 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363261+0000", 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5713000000000001e-05 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363269+0000", 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3680000000000002e-06 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.363277+0000", 2024-04-26T12:10:49.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2150000000000004e-06 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367695+0000", 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044179919999999999 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367808+0000", 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011369799999999999 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.367953+0000", 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000144895 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381021+0000", 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013067725000000001 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381062+0000", 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1588999999999998e-05 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381087+0000", 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4664999999999998e-05 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:44.381106+0000", 2024-04-26T12:10:49.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9310999999999999e-05 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87531 5.8 5:1c7d1cb5:::benchmark_data_smithi045_43640_object87530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.347873+0000", 2024-04-26T12:10:49.324 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.8932223229999998, 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018238186, 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87531 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.347873+0000", 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.347873+0000", 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.347873+0000", 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.347931+0000", 2024-04-26T12:10:49.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8315e-05 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.347940+0000", 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1609999999999992e-06 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.347946+0000", 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4350000000000002e-06 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.349682+0000", 2024-04-26T12:10:49.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017357710000000001 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.349772+0000", 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9592999999999994e-05 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.349863+0000", 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0835999999999996e-05 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.351477+0000", 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001614564 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.366046+0000", 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.01456847 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.366077+0000", 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1627000000000001e-05 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.366111+0000", 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4014999999999999e-05 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87570 5.4 5:2234c8fa:::benchmark_data_smithi045_43640_object87569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.369251+0000", 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.8718442159999999, 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017983936999999998, 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87570 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.369251+0000", 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.369251+0000", 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.369251+0000", 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.369304+0000", 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3624e-05 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.369312+0000", 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.61e-06 2024-04-26T12:10:49.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.369319+0000", 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5459999999999997e-06 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.371633+0000", 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023147850000000002 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.371766+0000", 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013273399999999999 2024-04-26T12:10:49.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.371910+0000", 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000143621 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.374442+0000", 2024-04-26T12:10:49.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0025324879999999998 2024-04-26T12:10:49.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.387176+0000", 2024-04-26T12:10:49.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012733321000000001 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.387214+0000", 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.387235+0000", 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1078e-05 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87760 5.0 5:0eab55fe:::benchmark_data_smithi045_43640_object87759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.461045+0000", 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.7800504209999999, 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019235848, 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87760 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461045+0000", 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461045+0000", 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461044+0000", 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461110+0000", 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5648000000000006e-05 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461118+0000", 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7619999999999995e-06 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461123+0000", 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3120000000000001e-06 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461448+0000", 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000324784 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461538+0000", 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9889000000000006e-05 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461628+0000", 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0241999999999994e-05 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.463071+0000", 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014425550000000001 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.480228+0000", 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017157281999999999 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.480259+0000", 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1489000000000003e-05 2024-04-26T12:10:49.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.480281+0000", 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1469000000000001e-05 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.342 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87777 5.4 5:23e67be4:::benchmark_data_smithi045_43640_object87776:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468193+0000", 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.772902357, 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018479659999999998, 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87777 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.343 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468193+0000", 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468193+0000", 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468193+0000", 2024-04-26T12:10:49.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468228+0000", 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5438999999999997e-05 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468233+0000", 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7870000000000001e-06 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468237+0000", 2024-04-26T12:10:49.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8569999999999997e-06 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468266+0000", 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9124000000000001e-05 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468375+0000", 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109527 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468484+0000", 2024-04-26T12:10:49.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010905500000000001 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471657+0000", 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031730080000000002 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.486575+0000", 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014917438999999999 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.486635+0000", 2024-04-26T12:10:49.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0133000000000002e-05 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.486673+0000", 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7790999999999998e-05 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.7727486240000001, 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:10:49.348 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:10:49.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:10:49.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:10:49.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.354 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.7711333809999998, 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:49.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.7687690859999998, 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:10:49.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:10:49.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.365 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87789 5.4 5:219e0f40:::benchmark_data_smithi045_43640_object87788:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.475059+0000", 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.7660367080000001, 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018242588000000001, 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87789 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:49.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475059+0000", 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475059+0000", 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475058+0000", 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475123+0000", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5456999999999993e-05 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475131+0000", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3939999999999998e-06 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475136+0000", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5330000000000002e-06 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475174+0000", 2024-04-26T12:10:49.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7713999999999998e-05 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475301+0000", 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012718199999999999 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475549+0000", 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00024830799999999998 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:49.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477613+0000", 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020634749999999999 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493256+0000", 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015643527000000001 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493280+0000", 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3847999999999999e-05 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:49.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493301+0000", 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0998000000000001e-05 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:49.371 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:49.372 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:49.373 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.371+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:49.473 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.472+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:49.562 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:49.562 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:49.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.562 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:97065 5.a 5:5bcb48e4:::benchmark_data_smithi045_43640_object97064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:49.562 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.555214+0000", 2024-04-26T12:10:49.562 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0055792899999999998, 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056046250000000002, 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 97065 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555214+0000", 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555214+0000", 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555213+0000", 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555284+0000", 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0649999999999996e-05 2024-04-26T12:10:49.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555295+0000", 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1185999999999999e-05 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555303+0000", 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555341+0000", 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8483999999999999e-05 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555457+0000", 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000116168 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.555596+0000", 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138446 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.559877+0000", 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042808880000000001 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:97062 5.0 e33/17 5:0738a03e:::benchmark_data_smithi045_43640_object97061:head v 33'6101, mlcod=33'6097)", 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.556588+0000", 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0042057220000000003, 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004286771, 2024-04-26T12:10:49.567 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.556588+0000", 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.556588+0000", 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.556587+0000", 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.556620+0000", 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3173000000000002e-05 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.556654+0000", 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3317e-05 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.556662+0000", 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0879999999999995e-06 2024-04-26T12:10:49.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557032+0000", 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00037050700000000001 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557052+0000", 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9578000000000001e-05 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.571 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:97068 5.a 5:5eeb0779:::benchmark_data_smithi045_43640_object97067:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.557348+0000", 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0034457120000000001, 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035658399999999998, 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 97068 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557348+0000", 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557348+0000", 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557347+0000", 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557449+0000", 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000101995 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557460+0000", 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1477999999999999e-05 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557466+0000", 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6849999999999998e-06 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557502+0000", 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5855000000000001e-05 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557602+0000", 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9984999999999999e-05 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557760+0000", 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015813599999999999 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560316+0000", 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025557620000000001 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:97067 5.e e33/17 5:719c47a4:::benchmark_data_smithi045_43640_object97066:head v 33'6096, mlcod=33'6094)", 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.557866+0000", 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029270949999999998, 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030922940000000002, 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.576 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557866+0000", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557866+0000", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557866+0000", 2024-04-26T12:10:49.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557923+0000", 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7080999999999998e-05 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557932+0000", 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7350000000000002e-06 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557938+0000", 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0159999999999997e-06 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557969+0000", 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1770999999999998e-05 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.557981+0000", 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1855000000000001e-05 2024-04-26T12:10:49.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:97074 5.1 5:88649e0f:::benchmark_data_smithi045_43640_object97073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.558016+0000", 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0027777069999999999, 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029784590000000001, 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.580 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 97074 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558016+0000", 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558016+0000", 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558015+0000", 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558073+0000", 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7945000000000002e-05 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558081+0000", 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3809999999999999e-06 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558088+0000", 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1510000000000001e-06 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558131+0000", 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3631000000000003e-05 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.584 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558257+0000", 2024-04-26T12:10:49.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012600999999999999 2024-04-26T12:10:49.584 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.584 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.585 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.585 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:97069 5.0 e33/17 5:0cfcc112:::benchmark_data_smithi045_43640_object97068:head v 33'6102, mlcod=33'6098)", 2024-04-26T12:10:49.585 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.558149+0000", 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.002644104, 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028816169999999999, 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558149+0000", 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558149+0000", 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558149+0000", 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558211+0000", 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2310000000000005e-05 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558218+0000", 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0199999999999997e-06 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558223+0000", 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7620000000000003e-06 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.559945+0000", 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00172208 2024-04-26T12:10:49.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.559957+0000", 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:97071 5.8 e33/17 5:1eee710d:::benchmark_data_smithi045_43640_object97070:head v 33'5914, mlcod=33'5912)", 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.558391+0000", 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0024025169999999998, 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026727719999999999, 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558391+0000", 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558391+0000", 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558391+0000", 2024-04-26T12:10:49.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558464+0000", 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3831000000000005e-05 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558471+0000", 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8029999999999999e-06 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.558476+0000", 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8280000000000002e-06 2024-04-26T12:10:49.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.559936+0000", 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014599859999999999 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.559950+0000", 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3569e-05 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:97072 5.e e33/17 5:7b6cadb4:::benchmark_data_smithi045_43640_object97071:head v 33'6097, mlcod=33'6094)", 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.560166+0000", 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00062715199999999996, 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000932248, 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560166+0000", 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.594 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560166+0000", 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560166+0000", 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560232+0000", 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5957999999999994e-05 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560242+0000", 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0550999999999999e-05 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560249+0000", 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3759999999999996e-06 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560281+0000", 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2660000000000002e-05 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560297+0000", 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5841999999999998e-05 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:97077 5.c 5:3c6594c7:::benchmark_data_smithi045_43640_object97076:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.560278+0000", 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00051506100000000003, 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085513099999999997, 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.597 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 97077 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560278+0000", 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560278+0000", 2024-04-26T12:10:49.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560277+0000", 2024-04-26T12:10:49.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560354+0000", 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6137000000000006e-05 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560364+0000", 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0402e-05 2024-04-26T12:10:49.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560372+0000", 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6930000000000007e-06 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560427+0000", 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4879000000000001e-05 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560549+0000", 2024-04-26T12:10:49.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122077 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:97065 5.a e33/17)", 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.560379+0000", 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00041441699999999999, 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00078934700000000003, 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560379+0000", 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560379+0000", 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560379+0000", 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560382+0000", 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8160000000000004e-06 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560390+0000", 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2740000000000002e-06 2024-04-26T12:10:49.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560395+0000", 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2129999999999999e-06 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:97078 5.7 5:e6d8c60c:::benchmark_data_smithi045_43640_object97077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.560435+0000", 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000358198, 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00076461900000000002, 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:49.605 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 97078 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560435+0000", 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560435+0000", 2024-04-26T12:10:49.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560435+0000", 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560510+0000", 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5642000000000005e-05 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560521+0000", 2024-04-26T12:10:49.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0614999999999999e-05 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560528+0000", 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7220000000000002e-06 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560569+0000", 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0958000000000003e-05 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560665+0000", 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6343999999999998e-05 2024-04-26T12:10:49.608 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:97079 5.2 5.c670c372 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.560540+0000", 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00025391699999999999, 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00069611399999999996, 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 97079 2024-04-26T12:10:49.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.610 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:49.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.610 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:49.610 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560540+0000", 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560540+0000", 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560539+0000", 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:49.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560576+0000", 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560583+0000", 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0520000000000004e-06 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.560589+0000", 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:10:49.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.613 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:49.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:49.613 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:49.613 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 12 2024-04-26T12:10:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:49.614 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 37 16 97181 97165 164.113 144.312 0.00369583 0.00608955 2024-04-26T12:10:49.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:49.615 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:49.612+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:49.715 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.714+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:49.816 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.815+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:49.849 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:49.849 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:49.849 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:49.849 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:49.849 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:49.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:49.917 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:49.916+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.018 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:50.017+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.064 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:50.064 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.810119566000001, 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.065 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:50.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.070 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.255819845, 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:50.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.074 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.084316297000001, 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5931272659999998, 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5907758899999997, 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5891330190000001, 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.098 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.099 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.100 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87786 5.4 e31/17 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head v 31'5547, mlcod=31'5542)", 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5873363940000003, 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019118006999999999, 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473757+0000", 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473824+0000", 2024-04-26T12:10:50.102 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6338000000000001e-05 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473836+0000", 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473843+0000", 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.103 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480070+0000", 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062268760000000001 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480092+0000", 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2546000000000001e-05 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492858+0000", 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012765914 2024-04-26T12:10:50.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492876+0000", 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8051e-05 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.106 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:88303 5.a 5:56ab7b61:::benchmark_data_smithi045_43640_object88302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:50.107 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:50.107 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3374951319999999, 2024-04-26T12:10:50.107 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019532260999999999, 2024-04-26T12:10:50.107 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.107 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.107 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.108 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.108 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.108 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 88303 2024-04-26T12:10:50.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.108 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.109 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.109 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:50.109 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.109 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.110 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:50.111 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.111 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.111 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723634+0000", 2024-04-26T12:10:50.111 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5278999999999999e-05 2024-04-26T12:10:50.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.112 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.112 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723641+0000", 2024-04-26T12:10:50.112 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:10:50.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.113 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.113 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723647+0000", 2024-04-26T12:10:50.113 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:10:50.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.114 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.114 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733456+0000", 2024-04-26T12:10:50.114 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098080170000000005 2024-04-26T12:10:50.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.115 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.115 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733578+0000", 2024-04-26T12:10:50.115 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122633 2024-04-26T12:10:50.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.115 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:50.116 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733728+0000", 2024-04-26T12:10:50.116 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149684 2024-04-26T12:10:50.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.116 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:50.116 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.735926+0000", 2024-04-26T12:10:50.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021982989999999999 2024-04-26T12:10:50.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.117 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743048+0000", 2024-04-26T12:10:50.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0071219910000000003 2024-04-26T12:10:50.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.118 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.118 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743094+0000", 2024-04-26T12:10:50.118 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5781000000000001e-05 2024-04-26T12:10:50.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.119 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.119 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743132+0000", 2024-04-26T12:10:50.119 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7795e-05 2024-04-26T12:10:50.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.120 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.120 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.120 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:50.120 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:50.121 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.854758379, 2024-04-26T12:10:50.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:10:50.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.121 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.121 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.122 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.122 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.122 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:10:50.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.122 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.123 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.123 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:50.123 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.123 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.124 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:50.124 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.124 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.124 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:50.125 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.125 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.125 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:10:50.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:10:50.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.126 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.126 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:10:50.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:10:50.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.127 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.127 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:10:50.127 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:10:50.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.128 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.128 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:10:50.128 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:10:50.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.129 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.129 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:10:50.129 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:10:50.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.129 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:10:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:10:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:10:50.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:10:50.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.131 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.131 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:10:50.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:10:50.132 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.132 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.132 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.132 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:50.133 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:50.133 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.8544191130000001, 2024-04-26T12:10:50.133 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:10:50.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.134 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.134 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.134 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.134 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.134 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:10:50.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.135 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.135 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.135 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:50.135 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.136 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.136 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:50.136 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.137 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.137 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:50.137 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.138 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.138 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:10:50.138 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:10:50.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.139 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.139 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:10:50.139 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:50.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.139 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.140 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:10:50.140 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:10:50.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.140 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.140 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:10:50.141 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:10:50.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.141 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.141 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:10:50.141 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:10:50.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.142 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.142 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:10:50.142 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:10:50.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.143 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.143 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:10:50.143 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:10:50.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.144 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.144 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:10:50.144 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:10:50.144 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.144 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.145 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.145 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:94003 5.1 5:8129722c:::benchmark_data_smithi045_43640_object94002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:50.145 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:50.145 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.8485263170000001, 2024-04-26T12:10:50.146 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018903178999999999, 2024-04-26T12:10:50.146 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.146 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.146 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.146 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.146 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.147 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 94003 2024-04-26T12:10:50.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.147 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.147 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.147 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:50.148 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.148 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.148 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:50.149 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.149 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.149 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212567+0000", 2024-04-26T12:10:50.149 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:50.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.150 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.150 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212594+0000", 2024-04-26T12:10:50.150 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6463999999999999e-05 2024-04-26T12:10:50.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.151 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.151 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212606+0000", 2024-04-26T12:10:50.151 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2283000000000001e-05 2024-04-26T12:10:50.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.152 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.152 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212614+0000", 2024-04-26T12:10:50.152 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:10:50.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.152 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.220138+0000", 2024-04-26T12:10:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0075244329999999996 2024-04-26T12:10:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.220265+0000", 2024-04-26T12:10:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012707800000000001 2024-04-26T12:10:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231382+0000", 2024-04-26T12:10:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011116892999999999 2024-04-26T12:10:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231426+0000", 2024-04-26T12:10:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3520999999999999e-05 2024-04-26T12:10:50.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.156 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.156 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231471+0000", 2024-04-26T12:10:50.156 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5738999999999997e-05 2024-04-26T12:10:50.156 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.157 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.157 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.157 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96725 5.b e33/17 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head v 33'5948, mlcod=33'5945)", 2024-04-26T12:10:50.158 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:50.158 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.67130123200000003, 2024-04-26T12:10:50.158 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019714763, 2024-04-26T12:10:50.158 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.158 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.158 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.160 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.160 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:50.160 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.160 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.160 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.160 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.161 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:50.161 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.161 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.161 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389826+0000", 2024-04-26T12:10:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2876999999999997e-05 2024-04-26T12:10:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389836+0000", 2024-04-26T12:10:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0040999999999999e-05 2024-04-26T12:10:50.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.163 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.163 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389843+0000", 2024-04-26T12:10:50.163 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1280000000000002e-06 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.393848+0000", 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004005046 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.164 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.393867+0000", 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.944e-05 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.409481+0000", 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015614209 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.409508+0000", 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6656999999999999e-05 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.165 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.57767760700000004, 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.166 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:10:50.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.170 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.57442263000000005, 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.175 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.57192495499999996, 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:10:50.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:10:50.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.180 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96945 5.3 5:c6e61229:::benchmark_data_smithi045_43640_object96944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489631+0000", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.57146370999999996, 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019274807000000001, 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96945 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489631+0000", 2024-04-26T12:10:50.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489631+0000", 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489630+0000", 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489754+0000", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012368899999999999 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489764+0000", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0079e-05 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489772+0000", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8180000000000004e-06 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490193+0000", 2024-04-26T12:10:50.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00042151999999999999 2024-04-26T12:10:50.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490347+0000", 2024-04-26T12:10:50.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015406299999999999 2024-04-26T12:10:50.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.508787+0000", 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018440127000000001 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.508836+0000", 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8547000000000001e-05 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.508906+0000", 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9704999999999998e-05 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.57124165400000004, 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:10:50.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:10:50.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.56912113799999997, 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.56690712700000001, 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.195 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:50.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.199 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96957 5.6 5:60c1b4d6:::benchmark_data_smithi045_43640_object96956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.56521422099999996, 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019761825, 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96957 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495941+0000", 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0843e-05 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495948+0000", 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1459999999999999e-06 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495953+0000", 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7929999999999997e-06 2024-04-26T12:10:50.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509209+0000", 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013256341 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509347+0000", 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138169 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515532+0000", 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061848040000000003 2024-04-26T12:10:50.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515572+0000", 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515642+0000", 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9931000000000005e-05 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:50.205 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:50.205 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:50.205 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:50.207 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:50.205+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.207 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:50.306 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:50.305+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.381 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:50.382 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:50.383 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:50.401 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:50.403 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:50.406 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:50.407 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:50.407 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:50.406+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:50.508 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:50.507+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:50.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 38 16 99482 99466 163.578 143.812 0.00536194 0.00610984 2024-04-26T12:10:50.611 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:50.608+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:50.620 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:50.620 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:50.633 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:50.710 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:50.709+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.808 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:50.808 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:50.810 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:50.809+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.824 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:50.912 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:50.911+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:50.971 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:10:51.013 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:51.013 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:51.014 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.012+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:51.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:10:51.082 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-04-26T12:10:51.117 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.116+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.183 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-04-26T12:10:51.215 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.214+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.256 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:51.256 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:51.272 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:51.316 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.315+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.416 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:51.415+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:51.514 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:51.514 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:51.518 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:51.517+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:51.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:51.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 39 16 101656 101640 162.867 135.875 0.00355839 0.00613651 2024-04-26T12:10:51.618 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.617+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:51.719 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.718+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.722 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:51.819 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:51.818+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:51.897 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:51.898 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:51.913 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:51.957 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:51.956+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:52.021 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:52.020+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:10:52.084 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:52.085 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:52.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:52.142 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:52.141+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:52.223 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:52.222+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:52.287 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:52.287 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:52.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:52.343 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:52.342+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:52.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:52.424 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:52.423+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:52.525 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:52.524+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:52.540 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:52.540 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:52.557 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:52.584 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:52.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:2024-04-26T12:10:52.606969+0000 min lat: 0.00110881 max lat: 1.02576 avg lat: 0.00615701 2024-04-26T12:10:52.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T12:10:52.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 40 16 103917 103901 162.328 141.312 0.00790481 0.00615701 2024-04-26T12:10:52.610 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:52.610 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:52.610 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:52.610 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:52.613 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:52.613 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:52.626 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:52.625+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:52.726 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:52.725+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:52.756 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.501235325, 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:52.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:52.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:52.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.946935604, 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.762 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.775432056, 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:52.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:52.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:52.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.2842430250000003, 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.775 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:52.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:52.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.2818916490000003, 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.782 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:52.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:52.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:52.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:52.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:52.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:52.786 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.787 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.787 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.787 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:52.787 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.2802487779999998, 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.792 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87786 5.4 e31/17 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head v 31'5547, mlcod=31'5542)", 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.2784521529999999, 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019118006999999999, 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473758+0000", 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473757+0000", 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473824+0000", 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6338000000000001e-05 2024-04-26T12:10:52.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473836+0000", 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473843+0000", 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480070+0000", 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062268760000000001 2024-04-26T12:10:52.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.480092+0000", 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2546000000000001e-05 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492858+0000", 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012765914 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492876+0000", 2024-04-26T12:10:52.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8051e-05 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:88303 5.a 5:56ab7b61:::benchmark_data_smithi045_43640_object88302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.0286108909999996, 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019532260999999999, 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.797 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 88303 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723599+0000", 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723634+0000", 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5278999999999999e-05 2024-04-26T12:10:52.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723641+0000", 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.723647+0000", 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:10:52.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733456+0000", 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098080170000000005 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733578+0000", 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122633 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.733728+0000", 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000149684 2024-04-26T12:10:52.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.735926+0000", 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021982989999999999 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743048+0000", 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0071219910000000003 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743094+0000", 2024-04-26T12:10:52.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5781000000000001e-05 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.743132+0000", 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7795e-05 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5458741380000003, 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:10:52.803 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:10:52.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:10:52.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5455348720000002, 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.809 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:10:52.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.814 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:94003 5.1 5:8129722c:::benchmark_data_smithi045_43640_object94002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5396420759999998, 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018903178999999999, 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 94003 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.815 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212568+0000", 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212567+0000", 2024-04-26T12:10:52.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212594+0000", 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6463999999999999e-05 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212606+0000", 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2283000000000001e-05 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212614+0000", 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5809999999999999e-06 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.220138+0000", 2024-04-26T12:10:52.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0075244329999999996 2024-04-26T12:10:52.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.220265+0000", 2024-04-26T12:10:52.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012707800000000001 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231382+0000", 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011116892999999999 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231426+0000", 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3520999999999999e-05 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.231471+0000", 2024-04-26T12:10:52.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5738999999999997e-05 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96725 5.b e33/17 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head v 33'5948, mlcod=33'5945)", 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.3624169909999999, 2024-04-26T12:10:52.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019714763, 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389826+0000", 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2876999999999997e-05 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389836+0000", 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0040999999999999e-05 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389843+0000", 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1280000000000002e-06 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.393848+0000", 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004005046 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.393867+0000", 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.944e-05 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.409481+0000", 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015614209 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.409508+0000", 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6656999999999999e-05 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2687933660000001, 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:10:52.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:10:52.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:10:52.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:52.830 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.265538389, 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:10:52.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:10:52.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2630407140000002, 2024-04-26T12:10:52.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:10:52.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:10:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96945 5.3 5:c6e61229:::benchmark_data_smithi045_43640_object96944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489631+0000", 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2625794689999998, 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019274807000000001, 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.841 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96945 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489631+0000", 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489631+0000", 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489630+0000", 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489754+0000", 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012368899999999999 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489764+0000", 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0079e-05 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489772+0000", 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8180000000000004e-06 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490193+0000", 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00042151999999999999 2024-04-26T12:10:52.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490347+0000", 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015406299999999999 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.508787+0000", 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018440127000000001 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.508836+0000", 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8547000000000001e-05 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.508906+0000", 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9704999999999998e-05 2024-04-26T12:10:52.846 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2623574130000002, 2024-04-26T12:10:52.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:10:52.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:10:52.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:10:52.852 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.852 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.852 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.853 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:10:52.853 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:52.853 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.260236897, 2024-04-26T12:10:52.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:10:52.853 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.854 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.854 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:52.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:52.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:52.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:10:52.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:10:52.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:10:52.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:10:52.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:10:52.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:10:52.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:10:52.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:10:52.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:10:52.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:10:52.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:10:52.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:10:52.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:10:52.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:10:52.862 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.862 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.862 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.863 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:10:52.863 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:52.863 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.258022886, 2024-04-26T12:10:52.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:10:52.864 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.864 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.864 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:52.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:52.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:52.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:10:52.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:10:52.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:10:52.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:10:52.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:10:52.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:10:52.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:10:52.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:10:52.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:10:52.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:10:52.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:10:52.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:10:52.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.873 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96957 5.6 5:60c1b4d6:::benchmark_data_smithi045_43640_object96956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:52.873 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:52.873 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2563299799999998, 2024-04-26T12:10:52.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019761825, 2024-04-26T12:10:52.874 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:52.874 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:52.874 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:52.874 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:52.874 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:52.874 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96957 2024-04-26T12:10:52.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.875 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:52.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:52.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:52.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:52.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:52.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:52.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:52.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495941+0000", 2024-04-26T12:10:52.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0843e-05 2024-04-26T12:10:52.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:52.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495948+0000", 2024-04-26T12:10:52.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1459999999999999e-06 2024-04-26T12:10:52.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:52.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495953+0000", 2024-04-26T12:10:52.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7929999999999997e-06 2024-04-26T12:10:52.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:52.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509209+0000", 2024-04-26T12:10:52.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013256341 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509347+0000", 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138169 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:52.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515532+0000", 2024-04-26T12:10:52.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061848040000000003 2024-04-26T12:10:52.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:52.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515572+0000", 2024-04-26T12:10:52.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:10:52.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:52.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:52.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:52.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515642+0000", 2024-04-26T12:10:52.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9931000000000005e-05 2024-04-26T12:10:52.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.884 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:52.884 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:52.885 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:52.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:52.887 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:52.886+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:52.987 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:52.986+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104941 5.8 5:1986f3ee:::benchmark_data_smithi045_43640_object104940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.060018+0000", 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0048714739999999998, 2024-04-26T12:10:53.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048999999999999998, 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104941 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060018+0000", 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060018+0000", 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060017+0000", 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060150+0000", 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013270799999999999 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060157+0000", 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.216e-06 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060162+0000", 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4490000000000001e-06 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060218+0000", 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6134000000000002e-05 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060303+0000", 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4852999999999995e-05 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.060385+0000", 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1897999999999994e-05 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062162+0000", 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017773730000000001 2024-04-26T12:10:53.070 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104943 5.9 5:949947fa:::benchmark_data_smithi045_43640_object104942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.061960+0000", 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.002929269, 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030580210000000002, 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.071 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104943 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.061960+0000", 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.061960+0000", 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.061959+0000", 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062024+0000", 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4261e-05 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062033+0000", 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5670000000000001e-06 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062039+0000", 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9340000000000003e-06 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062083+0000", 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4162000000000002e-05 2024-04-26T12:10:53.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062209+0000", 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012578200000000001 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104945 5.4 5:27b136c9:::benchmark_data_smithi045_43640_object104944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.062162+0000", 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0027271919999999998, 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029359120000000002, 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.075 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104945 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062162+0000", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062162+0000", 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062161+0000", 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062203+0000", 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1692e-05 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062212+0000", 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1050000000000001e-06 2024-04-26T12:10:53.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062218+0000", 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062248+0000", 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0088000000000001e-05 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062323+0000", 2024-04-26T12:10:53.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5210000000000007e-05 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062406+0000", 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3659000000000007e-05 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064009+0000", 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016025939999999999 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.080 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104947 5.8 5:1ed0377b:::benchmark_data_smithi045_43640_object104946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.062855+0000", 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0020343280000000002, 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023361079999999999, 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104947 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062855+0000", 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062855+0000", 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062854+0000", 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062925+0000", 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0801000000000002e-05 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062936+0000", 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0869e-05 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062943+0000", 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0509999999999999e-06 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.062982+0000", 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8727999999999999e-05 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.063097+0000", 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011571 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.063229+0000", 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131734 2024-04-26T12:10:53.084 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104948 5.9 5:9d49e73e:::benchmark_data_smithi045_43640_object104947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.063958+0000", 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00093154900000000005, 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013169169999999999, 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104948 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.063958+0000", 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.063958+0000", 2024-04-26T12:10:53.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.063957+0000", 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064038+0000", 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0543000000000005e-05 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064048+0000", 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9629999999999993e-06 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064055+0000", 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2520000000000002e-06 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064133+0000", 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7998999999999996e-05 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064275+0000", 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014232900000000001 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104953 5.0 5:091d4263:::benchmark_data_smithi045_43640_object104952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.064783+0000", 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.000106575, 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00057101799999999996, 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.089 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104953 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064783+0000", 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064783+0000", 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064782+0000", 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064860+0000", 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8187000000000002e-05 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064873+0000", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2386e-05 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064880+0000", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3699999999999997e-06 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064933+0000", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2673000000000002e-05 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.065097+0000", 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000164628 2024-04-26T12:10:53.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.065252+0000", 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015496800000000001 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:104954 5.9 5.23e8b679 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:53.064887+0000", 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 2.554e-06, 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00053720799999999996, 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:53.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 104954 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064887+0000", 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064887+0000", 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064886+0000", 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064913+0000", 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6579000000000001e-05 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064921+0000", 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:10:53.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:53.064926+0000", 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8309999999999997e-06 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 7 2024-04-26T12:10:53.096 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:53.098 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:53.098 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:53.096+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:53.198 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:53.197+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:53.299 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:53.298+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:53.309 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:53.309 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:53.309 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:53.309 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:53.309 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:53.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:53.400 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:53.400+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:53.501 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:53.500+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:53.539 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:53.539 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.612485849999999, 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.540 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:53.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:53.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:53.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.008875489000001, 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68100 5.d 5:bee81212:::benchmark_data_smithi045_43640_object68099:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.001804679999999, 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019203250000000002, 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.551 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68100 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534359+0000", 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534394+0000", 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5481999999999997e-05 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534400+0000", 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:10:53.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.534404+0000", 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.585e-06 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536672+0000", 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022677349999999999 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536779+0000", 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107212 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.536942+0000", 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016312 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.538894+0000", 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019518739999999999 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553500+0000", 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014605775999999999 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553535+0000", 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5363e-05 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.553563+0000", 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7521e-05 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.556 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.804594701999999, 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:53.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.562 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.565 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.804330262000001, 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:53.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:53.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:53.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:53.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.000575962999999, 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:53.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:53.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:78400 5.4 5:298bb304:::benchmark_data_smithi045_43640_object78399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:53.577 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.378917288, 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019529787, 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 78400 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157246+0000", 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157288+0000", 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:10:53.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157295+0000", 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157300+0000", 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0989999999999998e-06 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159342+0000", 2024-04-26T12:10:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020422750000000001 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159466+0000", 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012425000000000001 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159608+0000", 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141738 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.162201+0000", 2024-04-26T12:10:53.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002592652 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176711+0000", 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014510383999999999 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176744+0000", 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2252999999999998e-05 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176777+0000", 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3024000000000001e-05 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87760 5.0 5:0eab55fe:::benchmark_data_smithi045_43640_object87759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.461045+0000", 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.0751190029999993, 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019235848, 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.583 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87760 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461045+0000", 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461045+0000", 2024-04-26T12:10:53.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461044+0000", 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461110+0000", 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5648000000000006e-05 2024-04-26T12:10:53.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461118+0000", 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7619999999999995e-06 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461123+0000", 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3120000000000001e-06 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461448+0000", 2024-04-26T12:10:53.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000324784 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461538+0000", 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9889000000000006e-05 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.461628+0000", 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0241999999999994e-05 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.463071+0000", 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014425550000000001 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.480228+0000", 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017157281999999999 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.480259+0000", 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1489000000000003e-05 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.480281+0000", 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1469000000000001e-05 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.0678172060000009, 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:10:53.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:10:53.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:10:53.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.0662019629999993, 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.595 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:10:53.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:10:53.600 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.0638376679999997, 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:10:53.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:10:53.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:10:53.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.1497863549999998, 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:10:53.607 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.610 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:10:53.610 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:10:53.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.610 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:10:53.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:10:53.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.613 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96735 5.b 5:de09d9e8:::benchmark_data_smithi045_43640_object96734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.1450771949999998, 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020069007, 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.614 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96735 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.615 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391086+0000", 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391144+0000", 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8223000000000001e-05 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391155+0000", 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0530000000000001e-05 2024-04-26T12:10:53.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391170+0000", 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4722999999999999e-05 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391287+0000", 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117304 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391381+0000", 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3951999999999998e-05 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391470+0000", 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9425999999999994e-05 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392922+0000", 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001451665 2024-04-26T12:10:53.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411075+0000", 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018153385000000001 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411120+0000", 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4799999999999998e-05 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411156+0000", 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5728000000000001e-05 2024-04-26T12:10:53.619 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0551067749999996, 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:10:53.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:53.621 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.622 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.624 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0498990040000002, 2024-04-26T12:10:53.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:10:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0467000459999998, 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.631 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.632 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:10:53.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.046448238, 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.637 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.639 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:10:53.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.642 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0437922000000004, 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.643 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:10:53.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0422854309999998, 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:10:53.648 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:10:53.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:10:53.653 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.0396749779999999, 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.654 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:53.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:53.659 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:53.660 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 41 16 106239 106223 161.908 145.125 0.00648346 0.00617272 2024-04-26T12:10:53.661 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:53.662 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:53.659+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:53.761 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:53.760+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106758 5.7 5:e736b57a:::benchmark_data_smithi045_43640_object106757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.845344+0000", 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.005152116, 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051845290000000002, 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.853 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106758 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845344+0000", 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845344+0000", 2024-04-26T12:10:53.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845343+0000", 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845470+0000", 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012673799999999999 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845479+0000", 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2529999999999993e-06 2024-04-26T12:10:53.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845487+0000", 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0979999999999994e-06 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845533+0000", 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6507e-05 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845669+0000", 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013588700000000001 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.856 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106761 5.3 5:c51858dc:::benchmark_data_smithi045_43640_object106760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.845499+0000", 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0049965219999999998, 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051161569999999996, 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106761 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845499+0000", 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845499+0000", 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845499+0000", 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845582+0000", 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2781000000000006e-05 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845590+0000", 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0360000000000006e-06 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845597+0000", 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3139999999999998e-06 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845753+0000", 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000156498 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845934+0000", 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00018109499999999999 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106762 5.7 5:eabe6ab2:::benchmark_data_smithi045_43640_object106761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.845722+0000", 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0047738390000000002, 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049759599999999998, 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106762 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845722+0000", 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845722+0000", 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845721+0000", 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845834+0000", 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113139 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845844+0000", 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845852+0000", 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8189999999999992e-06 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847760+0000", 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00190734 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847871+0000", 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000111084 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106765 5.c 5:3e02f1dc:::benchmark_data_smithi045_43640_object106764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.845925+0000", 2024-04-26T12:10:53.864 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0045708509999999999, 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048593539999999998, 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106765 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845925+0000", 2024-04-26T12:10:53.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845925+0000", 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.845924+0000", 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846029+0000", 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104616 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846037+0000", 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2460000000000003e-06 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846045+0000", 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2439999999999993e-06 2024-04-26T12:10:53.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846090+0000", 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846229+0000", 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013857100000000001 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106767 5.6 5:66f3c740:::benchmark_data_smithi045_43640_object106766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.846054+0000", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0044419020000000002, 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048093520000000002, 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106767 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846054+0000", 2024-04-26T12:10:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846054+0000", 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846053+0000", 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846138+0000", 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4583e-05 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846146+0000", 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846154+0000", 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9189999999999999e-06 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846192+0000", 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7301000000000001e-05 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.846316+0000", 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012389399999999999 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106757 5.e e34/17 5:7b8da080:::benchmark_data_smithi045_43640_object106756:head v 34'6683, mlcod=34'6679)", 2024-04-26T12:10:53.872 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.847566+0000", 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029302680000000002, 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033631450000000001, 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847566+0000", 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847566+0000", 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847565+0000", 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847598+0000", 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2907000000000002e-05 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847608+0000", 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8530000000000004e-06 2024-04-26T12:10:53.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847614+0000", 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5130000000000002e-06 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847681+0000", 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6654000000000003e-05 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847699+0000", 2024-04-26T12:10:53.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7985000000000001e-05 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106760 5.8 e34/17 5:1da921c0:::benchmark_data_smithi045_43640_object106759:head v 34'6524, mlcod=34'6522)", 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.847620+0000", 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.002875444, 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033669680000000001, 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847620+0000", 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847620+0000", 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847620+0000", 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847651+0000", 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0941000000000001e-05 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847667+0000", 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.592e-05 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847674+0000", 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1450000000000002e-06 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847735+0000", 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0822000000000001e-05 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.847759+0000", 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3972e-05 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.879 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106766 5.4 e34/17 5:2be5c892:::benchmark_data_smithi045_43640_object106765:head v 34'6750, mlcod=34'6747)", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.848105+0000", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023907630000000002, 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002941674, 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848105+0000", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848105+0000", 2024-04-26T12:10:53.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848105+0000", 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848176+0000", 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1903999999999995e-05 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848192+0000", 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5327000000000001e-05 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848198+0000", 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4130000000000003e-06 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848278+0000", 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9624999999999997e-05 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848300+0000", 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2364000000000001e-05 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106771 5.3 5:cdf1c398:::benchmark_data_smithi045_43640_object106770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.848577+0000", 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0019188849999999999, 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025313530000000001, 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.883 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106771 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848577+0000", 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848577+0000", 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848576+0000", 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848626+0000", 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0219000000000001e-05 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848637+0000", 2024-04-26T12:10:53.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1073999999999999e-05 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848644+0000", 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8519999999999998e-06 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849344+0000", 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00070045800000000005 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849454+0000", 2024-04-26T12:10:53.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010991 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106768 5.4 e34/17 5:2d6e99fe:::benchmark_data_smithi045_43640_object106767:head v 34'6751, mlcod=34'6748)", 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.848869+0000", 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001626728, 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002303322, 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.887 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848869+0000", 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848869+0000", 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848869+0000", 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848965+0000", 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6778000000000001e-05 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848975+0000", 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4350000000000003e-06 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848981+0000", 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7219999999999996e-06 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850438+0000", 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001457818 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850461+0000", 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2821000000000001e-05 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.890 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106770 5.e e34/17 5:7db84558:::benchmark_data_smithi045_43640_object106769:head v 34'6684, mlcod=34'6679)", 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.848986+0000", 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001509645, 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022431209999999998, 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848986+0000", 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848986+0000", 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.848986+0000", 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849068+0000", 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1854000000000006e-05 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849076+0000", 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4630000000000001e-06 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849081+0000", 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.057e-06 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850003+0000", 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00092217700000000004 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850021+0000", 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7618999999999999e-05 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106772 5.c 5:3b4f3905:::benchmark_data_smithi045_43640_object106771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.849739+0000", 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00075729599999999997, 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001555549, 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106772 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849739+0000", 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849739+0000", 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849738+0000", 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849773+0000", 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5417999999999999e-05 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849784+0000", 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0351e-05 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849791+0000", 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3989999999999998e-06 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850478+0000", 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00068715599999999996 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850609+0000", 2024-04-26T12:10:53.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013058500000000001 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106773 5.7 5:eebf63b5:::benchmark_data_smithi045_43640_object106772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.849798+0000", 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000697597, 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0015669970000000001, 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:53.898 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106773 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849798+0000", 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849798+0000", 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849798+0000", 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849824+0000", 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6288999999999999e-05 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849831+0000", 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6560000000000003e-06 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849836+0000", 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0769999999999998e-06 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849870+0000", 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3787e-05 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.849994+0000", 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012466800000000001 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106769 5.4 e34/17)", 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.850386+0000", 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000109935, 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010443900000000001, 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850386+0000", 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850386+0000", 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850385+0000", 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850451+0000", 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5568999999999995e-05 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850460+0000", 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1079999999999999e-06 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.850466+0000", 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1739999999999997e-06 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.904 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106774 5.8 e34/17 5:12acad98:::benchmark_data_smithi045_43640_object106773:head v 34'6525, mlcod=34'6522)", 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.851200+0000", 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9992962, 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00028411700000000002, 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851200+0000", 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851200+0000", 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851199+0000", 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851261+0000", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1966999999999998e-05 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851275+0000", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3263e-05 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851282+0000", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9049999999999997e-06 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851379+0000", 2024-04-26T12:10:53.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6273000000000005e-05 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851397+0000", 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8017999999999999e-05 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:106775 5.b e34/17 5:d0a12e01:::benchmark_data_smithi045_43640_object106774:head v 34'6551, mlcod=34'6549)", 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.851294+0000", 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9992023, 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00025371699999999998, 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:53.908 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851294+0000", 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851294+0000", 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851293+0000", 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:53.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851326+0000", 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3019999999999999e-05 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851332+0000", 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9240000000000004e-06 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851336+0000", 2024-04-26T12:10:53.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.856e-06 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851365+0000", 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9512000000000001e-05 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.851384+0000", 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8450000000000001e-05 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:53.912 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:53.912 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 16 2024-04-26T12:10:53.912 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:53.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:53.914 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:53.912+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:54.014 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.013+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:10:54.116 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.114+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.140 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:54.140 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:54.140 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:54.141 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:54.141 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:54.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:54.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-26T12:10:54.219 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.218+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.320 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.319+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 19.103626095999999, 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.358 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:54.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.549326375, 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.377822826999999, 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8866337959999999, 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.375 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:54.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:54.379 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8842824199999999, 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:54.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:54.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:54.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:54.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8826395490000003, 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.1482649089999999, 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:10:54.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.1479256429999998, 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:10:54.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.400 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96725 5.b e33/17 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head v 33'5948, mlcod=33'5945)", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9648077619999995, 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019714763, 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:54.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389793+0000", 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389826+0000", 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2876999999999997e-05 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389836+0000", 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0040999999999999e-05 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.389843+0000", 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1280000000000002e-06 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.393848+0000", 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004005046 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.393867+0000", 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.944e-05 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.409481+0000", 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015614209 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.409508+0000", 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6656999999999999e-05 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8711841370000002, 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:10:54.408 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8679291600000001, 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:54.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8654314850000002, 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.413 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:10:54.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:10:54.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:10:54.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8647481839999998, 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.862627668, 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8604136570000005, 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.426 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:54.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:10:54.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:10:54.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96957 5.6 5:60c1b4d6:::benchmark_data_smithi045_43640_object96956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8587207509999999, 2024-04-26T12:10:54.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019761825, 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96957 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495941+0000", 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0843e-05 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495948+0000", 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1459999999999999e-06 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495953+0000", 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7929999999999997e-06 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509209+0000", 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013256341 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509347+0000", 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138169 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515532+0000", 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061848040000000003 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515572+0000", 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515642+0000", 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9931000000000005e-05 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:104008 5.2 5:415023c7:::benchmark_data_smithi045_43640_object104007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.7052776039999999, 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019916103000000001, 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 104008 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649354+0000", 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1266999999999997e-05 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649363+0000", 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2199999999999998e-06 2024-04-26T12:10:54.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649371+0000", 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658372+0000", 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090015549999999996 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658578+0000", 2024-04-26T12:10:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020576599999999999 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669112+0000", 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010534094000000001 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669165+0000", 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669240+0000", 2024-04-26T12:10:54.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4738000000000002e-05 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.494844846, 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.440 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.444 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.44461937200000001, 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.445 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:10:54.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:10:54.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:10:54.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.34100482799999998, 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:54.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:54.454 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:54.456 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:54.456 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.454+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.557 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:54.556+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:54.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 42 16 108458 108442 161.355 138.688 0.00501716 0.00619389 2024-04-26T12:10:54.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108532 5.8 5:19c30525:::benchmark_data_smithi045_43640_object108531:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.640318+0000", 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0010505309999999999, 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010786750000000001, 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108532 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640318+0000", 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640318+0000", 2024-04-26T12:10:54.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640318+0000", 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640370+0000", 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2667999999999998e-05 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640378+0000", 2024-04-26T12:10:54.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7300000000000005e-06 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640384+0000", 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7710000000000003e-06 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640419+0000", 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5340999999999999e-05 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640538+0000", 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119169 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640640+0000", 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010152700000000001 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108534 5.4 5:2ac0b6d2:::benchmark_data_smithi045_43640_object108533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.640472+0000", 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00089656399999999998, 2024-04-26T12:10:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010121819999999999, 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108534 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640472+0000", 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640472+0000", 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640472+0000", 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640532+0000", 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9760999999999999e-05 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640540+0000", 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1370000000000002e-06 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640546+0000", 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640574+0000", 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.739e-05 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640648+0000", 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4203999999999996e-05 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640752+0000", 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010365399999999999 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108518 5.4 5:25e7857b:::benchmark_data_smithi045_43640_object108517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.651 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.633422+0000", 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0079469640000000008, 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0081608949999999996, 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108518 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633422+0000", 2024-04-26T12:10:54.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633422+0000", 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633421+0000", 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633497+0000", 2024-04-26T12:10:54.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6438000000000002e-05 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633507+0000", 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7540000000000001e-06 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633516+0000", 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7879999999999995e-06 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633556+0000", 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0130999999999999e-05 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633683+0000", 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012715 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633808+0000", 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012427200000000001 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637294+0000", 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003486832 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108519 5.e 5:75329cba:::benchmark_data_smithi045_43640_object108518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.633565+0000", 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.007804231, 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0081294760000000001, 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.656 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108519 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633565+0000", 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633565+0000", 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633564+0000", 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633634+0000", 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9803999999999998e-05 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633642+0000", 2024-04-26T12:10:54.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1990000000000006e-06 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.633648+0000", 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.669e-06 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.635262+0000", 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016136429999999999 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.635408+0000", 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000146148 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.635581+0000", 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000172657 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.641275+0000", 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0056937510000000004 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.660 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108521 5.8 5:1e3a4031:::benchmark_data_smithi045_43640_object108520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.634179+0000", 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0071898090000000001, 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0075722080000000004, 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108521 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.661 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634179+0000", 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634179+0000", 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634178+0000", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634214+0000", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5311000000000001e-05 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634224+0000", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0473e-05 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634231+0000", 2024-04-26T12:10:54.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0380000000000002e-06 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634260+0000", 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9071e-05 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634346+0000", 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5855999999999999e-05 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634425+0000", 2024-04-26T12:10:54.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9402999999999999e-05 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640096+0000", 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0056704019999999997 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108523 5.8 5:1fa37f26:::benchmark_data_smithi045_43640_object108522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.634241+0000", 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0071281369999999997, 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0075760799999999998, 2024-04-26T12:10:54.665 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108523 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634241+0000", 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634241+0000", 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634240+0000", 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634265+0000", 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4737999999999999e-05 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634273+0000", 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1519999999999992e-06 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.634279+0000", 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8220000000000003e-06 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637312+0000", 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030330499999999998 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637425+0000", 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112613 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637552+0000", 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012739000000000001 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640129+0000", 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0025768000000000002 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108526 5.0 5:0d01e09c:::benchmark_data_smithi045_43640_object108525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.636115+0000", 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0052537390000000003, 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0057820809999999997, 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108526 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.636115+0000", 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.636115+0000", 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.636114+0000", 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.636196+0000", 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1438000000000002e-05 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.636207+0000", 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1542999999999999e-05 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.636215+0000", 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3799999999999996e-06 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637298+0000", 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010830519999999999 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637382+0000", 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3845999999999996e-05 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637467+0000", 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5965999999999997e-05 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.640236+0000", 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002768441 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108527 5.b 5:dbb80a8f:::benchmark_data_smithi045_43640_object108526:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.637135+0000", 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0042341030000000003, 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048558029999999997, 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.674 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108527 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637135+0000", 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637135+0000", 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637134+0000", 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637189+0000", 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5396999999999998e-05 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637200+0000", 2024-04-26T12:10:54.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.042e-05 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637207+0000", 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637277+0000", 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9999999999999994e-05 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637392+0000", 2024-04-26T12:10:54.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000114416 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637537+0000", 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014550899999999999 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.641600+0000", 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040623009999999999 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108528 5.e 5:7e6c5dd6:::benchmark_data_smithi045_43640_object108527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.637498+0000", 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0038712669999999999, 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045455859999999999, 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108528 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637498+0000", 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637498+0000", 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637497+0000", 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:54.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637586+0000", 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9579000000000004e-05 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637596+0000", 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2860000000000005e-06 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637602+0000", 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8589999999999999e-06 2024-04-26T12:10:54.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.639295+0000", 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016926840000000001 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.639418+0000", 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000122996 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.639512+0000", 2024-04-26T12:10:54.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3692999999999999e-05 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:108529 5.e 5:7a121938:::benchmark_data_smithi045_43640_object108528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:54.637680+0000", 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0036891350000000001, 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044056659999999999, 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:54.683 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 108529 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637680+0000", 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637680+0000", 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637679+0000", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637745+0000", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5710000000000006e-05 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637753+0000", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8820000000000001e-06 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:54.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.637758+0000", 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6500000000000001e-06 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.641355+0000", 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035969109999999999 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.641457+0000", 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000101368 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:54.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:54.641574+0000", 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117612 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 10 2024-04-26T12:10:54.687 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:54.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:54.689 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.687+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.789 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:54.788+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:54.790 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:54.813 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:54.813 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:54.813 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:54.813 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:54.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:54.816 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:54.890 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:54.888+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:54.912 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:54.912 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:54.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:54.991 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:54.990+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:10:55.092 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.091+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.147 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:55.147 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:55.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:55.192 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:55.191+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:55.293 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.292+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.350 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:55.350 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:55.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:55.411 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.406+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.495 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.494+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.596 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.595+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.602 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:55.603 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:55.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 43 16 110696 110680 160.855 139.875 0.00570473 0.00621322 2024-04-26T12:10:55.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:55.705 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.702+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.798 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.797+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:55.844 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:55.845 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:55.859 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:55.904 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:55.903+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:56.000 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:55.999+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:56.039 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:56.039 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:56.052 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:56.137 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:56.136+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:56.201 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:56.200+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:56.269 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:56.269 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:56.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:56.285 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T12:10:56.285 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:10:56.285 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:10:56.286 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:10:56.286 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:10:56.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:10:56.324 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:56.323+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:56.403 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:56.402+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:56.504 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:56.503+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:56.533 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "" 2024-04-26T12:10:56.533 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:56.538 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:56.538 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:56.553 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:56.605 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:56.604+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:56.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 44 16 112947 112931 160.396 140.688 0.00676639 0.00623092 2024-04-26T12:10:56.706 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:56.705+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:56.751 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:56.751 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:56.762 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:56.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:10:56.846 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:56.845+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:56.908 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:56.907+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:56.989 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:56.993 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:56.993 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:57.009 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:57.010 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:57.010 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:57.011 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:57.011 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:57.013 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:57.014 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:57.050 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.049+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:10:57.113 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.110+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.212 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.211+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.234 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:57.234 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:57.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:57.234 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.980430889000001, 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.235 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:57.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:57.240 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.426131168000001, 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:57.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:57.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:57.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.254627620000001, 2024-04-26T12:10:57.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:57.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:57.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:57.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 11.763438589, 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:57.254 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:57.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:57.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 11.761087213, 2024-04-26T12:10:57.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:57.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 11.759444342, 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:57.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:57.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.0250697019999997, 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.269 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:10:57.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:10:57.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:10:57.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.0247304360000005, 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.274 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:10:57.278 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.74798893, 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.7447339529999999, 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.283 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:10:57.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.742236278, 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.288 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:10:57.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:10:57.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:10:57.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.7415529769999996, 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:10:57.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.7394324609999998, 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.7372184500000003, 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.302 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.306 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96957 5.6 5:60c1b4d6:::benchmark_data_smithi045_43640_object96956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.7355255439999997, 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019761825, 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96957 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495880+0000", 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495941+0000", 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0843e-05 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495948+0000", 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1459999999999999e-06 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.495953+0000", 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7929999999999997e-06 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509209+0000", 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013256341 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509347+0000", 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138169 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515532+0000", 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061848040000000003 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515572+0000", 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515642+0000", 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9931000000000005e-05 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:104008 5.2 5:415023c7:::benchmark_data_smithi045_43640_object104007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:57.311 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.5820823969999998, 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019916103000000001, 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 104008 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649354+0000", 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1266999999999997e-05 2024-04-26T12:10:57.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649363+0000", 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2199999999999998e-06 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649371+0000", 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658372+0000", 2024-04-26T12:10:57.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090015549999999996 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658578+0000", 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020576599999999999 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669112+0000", 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010534094000000001 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669165+0000", 2024-04-26T12:10:57.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669240+0000", 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4738000000000002e-05 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.3716496390000001, 2024-04-26T12:10:57.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:10:57.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:10:57.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.3214241649999998, 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:10:57.321 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:10:57.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.2178096209999998, 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:10:57.326 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.330 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.056718894999999998, 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:57.331 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:10:57.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:10:57.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:57.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:57.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:57.336 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:57.337 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.336+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.338 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:57.438 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.437+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114945 5.e 5:783e4930:::benchmark_data_smithi045_43640_object114944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.504547+0000", 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0085129980000000008, 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0085416120000000005, 2024-04-26T12:10:57.514 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114945 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504547+0000", 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504547+0000", 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504546+0000", 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504609+0000", 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3060999999999998e-05 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504618+0000", 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6090000000000001e-06 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504623+0000", 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504662+0000", 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8152000000000003e-05 2024-04-26T12:10:57.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504782+0000", 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000120691 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504892+0000", 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0001099 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.508862+0000", 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039699569999999997 2024-04-26T12:10:57.518 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114947 5.e 5:728e745c:::benchmark_data_smithi045_43640_object114946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.504692+0000", 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0083681380000000007, 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0084861169999999996, 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.519 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114947 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504692+0000", 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504692+0000", 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504691+0000", 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504725+0000", 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3194000000000001e-05 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504732+0000", 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.148e-06 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.504737+0000", 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3109999999999996e-06 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.506711+0000", 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019743619999999999 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.506860+0000", 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014825600000000001 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.507005+0000", 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000145449 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509223+0000", 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022177239999999999 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114958 5.e 5:773730a5:::benchmark_data_smithi045_43640_object114957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.509373+0000", 2024-04-26T12:10:57.523 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0036867839999999998, 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003887064, 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114958 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509373+0000", 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509373+0000", 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509373+0000", 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509470+0000", 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7400999999999998e-05 2024-04-26T12:10:57.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509478+0000", 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2490000000000001e-06 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509483+0000", 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0690000000000001e-06 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509513+0000", 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0182999999999999e-05 2024-04-26T12:10:57.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509598+0000", 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4095e-05 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.509681+0000", 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3114000000000004e-05 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511570+0000", 2024-04-26T12:10:57.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018889 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114962 5.9 5:97fd7730:::benchmark_data_smithi045_43640_object114961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.511448+0000", 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001612474, 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018934220000000001, 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.528 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114962 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511448+0000", 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511448+0000", 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511447+0000", 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511548+0000", 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010149099999999999 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511558+0000", 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511567+0000", 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511598+0000", 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0281e-05 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511690+0000", 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2046999999999995e-05 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.531 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:114961 5.a e35/17 5:5427b69a:::benchmark_data_smithi045_43640_object114960:head v 35'7152, mlcod=35'7150)", 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.511886+0000", 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001174233, 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0015212069999999999, 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511886+0000", 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511886+0000", 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511885+0000", 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511958+0000", 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2949999999999998e-05 2024-04-26T12:10:57.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511965+0000", 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6170000000000003e-06 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.511969+0000", 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.98e-06 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.512003+0000", 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3824e-05 2024-04-26T12:10:57.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.512023+0000", 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0194e-05 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 5 2024-04-26T12:10:57.535 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:57.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:57.539 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.538+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 45 15 115183 115168 159.939 139.812 0.00300169 0.00624905 2024-04-26T12:10:57.640 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:57.639+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:57.710 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:57.711 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:10:57.711 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:10:57.711 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:10:57.711 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:57.725 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:57.772 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:57.771+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:57.841 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:57.840+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:10:57.908 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.981177123999998, 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:10:57.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.377566763000001, 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.915 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68557 5.8 5:1096472d:::benchmark_data_smithi045_43640_object68556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:57.920 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.173285975999999, 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019452774999999999, 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68557 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731569+0000", 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731698+0000", 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012874499999999999 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731717+0000", 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9660000000000002e-05 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731733+0000", 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5670000000000001e-05 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737313+0000", 2024-04-26T12:10:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055799689999999997 2024-04-26T12:10:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737404+0000", 2024-04-26T12:10:57.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1374999999999998e-05 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.737491+0000", 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6170999999999999e-05 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741651+0000", 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041600539999999998 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750933+0000", 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.009282574 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.750983+0000", 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9829e-05 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751022+0000", 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9097999999999997e-05 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:68559 5.8 5:140b78c3:::benchmark_data_smithi045_43640_object68558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.173021536, 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019287542000000001, 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 68559 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:57.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731834+0000", 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731828+0000", 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999938 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731866+0000", 2024-04-26T12:10:57.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7948000000000003e-05 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731882+0000", 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5903999999999999e-05 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.731889+0000", 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738483+0000", 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0065941949999999997 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738570+0000", 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7089000000000006e-05 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.738652+0000", 2024-04-26T12:10:57.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1694999999999996e-05 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.741660+0000", 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030087619999999999 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751061+0000", 2024-04-26T12:10:57.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0094003079999999996 2024-04-26T12:10:57.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751090+0000", 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:35.751121+0000", 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1183000000000003e-05 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.934 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:70365 5.d 5:b55b48ad:::benchmark_data_smithi045_43640_object70364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:57.935 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.369267236999999, 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019375521, 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 70365 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535588+0000", 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535587+0000", 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535617+0000", 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9070000000000001e-05 2024-04-26T12:10:57.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535624+0000", 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8669999999999994e-06 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535630+0000", 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535672+0000", 2024-04-26T12:10:57.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1511000000000003e-05 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535783+0000", 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011109500000000001 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.535916+0000", 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013321900000000001 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.539545+0000", 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036293190000000002 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554899+0000", 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015353459 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554937+0000", 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8633000000000001e-05 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:36.554964+0000", 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6267000000000001e-05 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:78400 5.4 5:298bb304:::benchmark_data_smithi045_43640_object78399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.747608562, 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019529787, 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.941 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 78400 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157246+0000", 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157288+0000", 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157295+0000", 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157300+0000", 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0989999999999998e-06 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159342+0000", 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020422750000000001 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159466+0000", 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012425000000000001 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159608+0000", 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141738 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.162201+0000", 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002592652 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176711+0000", 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014510383999999999 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176744+0000", 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2252999999999998e-05 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176777+0000", 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3024000000000001e-05 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.947 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.436508480000001, 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:10:57.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:10:57.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.434893237000001, 2024-04-26T12:10:57.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:57.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:10:57.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.432528941999999, 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.961 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:10:57.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.5184776289999995, 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:10:57.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:10:57.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96735 5.b 5:de09d9e8:::benchmark_data_smithi045_43640_object96734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.5137684690000004, 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020069007, 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96735 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391086+0000", 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391144+0000", 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8223000000000001e-05 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391155+0000", 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0530000000000001e-05 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391170+0000", 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4722999999999999e-05 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391287+0000", 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117304 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391381+0000", 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3951999999999998e-05 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391470+0000", 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9425999999999994e-05 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392922+0000", 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001451665 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411075+0000", 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018153385000000001 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411120+0000", 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4799999999999998e-05 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411156+0000", 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5728000000000001e-05 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4237980490000002, 2024-04-26T12:10:57.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:10:57.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:10:57.987 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4185902779999999, 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:10:57.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:10:57.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:57.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4153913199999995, 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:10:57.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:57.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:57.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:10:57.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4151395119999997, 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:10:58.001 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:58.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:10:58.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:10:58.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:10:58.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4124834740000001, 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.008 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:10:58.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:58.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:10:58.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.014 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4109767049999995, 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:10:58.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:10:58.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4083662520000004, 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:10:58.021 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:58.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:58.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114401 5.b 5:d2c6df93:::benchmark_data_smithi045_43640_object114400:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.64159290899999999, 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019964612, 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.028 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114401 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263287+0000", 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4953999999999999e-05 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:58.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263292+0000", 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263296+0000", 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.318e-06 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:58.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263336+0000", 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0153e-05 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263468+0000", 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000132137 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:58.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263607+0000", 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013891899999999999 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.265717+0000", 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021101660000000001 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.283144+0000", 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017426754999999999 2024-04-26T12:10:58.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.283190+0000", 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6383e-05 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.283227+0000", 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6677000000000001e-05 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.034 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.56176359300000001, 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.035 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:58.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:10:58.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:58.041 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:58.043 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:58.042+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:58.043 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:10:58.144 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:58.142+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:58.241 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:58.241 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:58.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116587 5.6 5:68174c73:::benchmark_data_smithi045_43640_object116586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.235164+0000", 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003190956, 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0032201270000000001, 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116587 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235164+0000", 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235164+0000", 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235164+0000", 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235300+0000", 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000136422 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235310+0000", 2024-04-26T12:10:58.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0006e-05 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235317+0000", 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235559+0000", 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00024212999999999999 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235699+0000", 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000140436 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116589 5.2 5:47f5105e:::benchmark_data_smithi045_43640_object116588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.235536+0000", 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0028191140000000002, 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029351529999999998, 2024-04-26T12:10:58.246 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116589 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235536+0000", 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235536+0000", 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235536+0000", 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235569+0000", 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3710000000000001e-05 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235578+0000", 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6139999999999992e-06 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235586+0000", 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6090000000000001e-06 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235759+0000", 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017300799999999999 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235877+0000", 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000117532 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116590 5.7 5:eb38b35b:::benchmark_data_smithi045_43640_object116589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.235597+0000", 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0027582499999999999, 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00296299, 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.250 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116590 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235597+0000", 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235597+0000", 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235596+0000", 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235627+0000", 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1010000000000003e-05 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235635+0000", 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3730000000000004e-06 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235641+0000", 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235774+0000", 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013363900000000001 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235885+0000", 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110475 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.253 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:116586 5.8 e36/17 5:12098b30:::benchmark_data_smithi045_43640_object116585:head v 36'7107, mlcod=36'7105)", 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.235663+0000", 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0026920410000000001, 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002966911, 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235663+0000", 2024-04-26T12:10:58.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235663+0000", 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235663+0000", 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235690+0000", 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7080000000000002e-05 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235698+0000", 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235704+0000", 2024-04-26T12:10:58.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4580000000000001e-06 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235734+0000", 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0632000000000001e-05 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235758+0000", 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4063e-05 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:116583 5.b e36/17 5:dc06b704:::benchmark_data_smithi045_43640_object116582:head v 36'7193, mlcod=36'7190)", 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.236621+0000", 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0017343689999999999, 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020709449999999998, 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.258 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236621+0000", 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236621+0000", 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236620+0000", 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236679+0000", 2024-04-26T12:10:58.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8631000000000002e-05 2024-04-26T12:10:58.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236691+0000", 2024-04-26T12:10:58.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1945e-05 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236698+0000", 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9240000000000001e-06 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.236984+0000", 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00028580800000000003 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.237001+0000", 2024-04-26T12:10:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7988000000000001e-05 2024-04-26T12:10:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.266 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.270 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.270 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:116591 5.4 e36/17 5:267d4c25:::benchmark_data_smithi045_43640_object116590:head v 36'7373, mlcod=36'7371)", 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.238005+0000", 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000349759, 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00076399699999999998, 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238005+0000", 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238005+0000", 2024-04-26T12:10:58.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238005+0000", 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238092+0000", 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6736000000000004e-05 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238100+0000", 2024-04-26T12:10:58.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3189999999999995e-06 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238106+0000", 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.596e-06 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238143+0000", 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6947999999999999e-05 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238165+0000", 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1594999999999999e-05 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116592 5.3 5:c959a9d9:::benchmark_data_smithi045_43640_object116591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.238056+0000", 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00029879599999999999, 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00077679300000000001, 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.275 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116592 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238056+0000", 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238056+0000", 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238055+0000", 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238123+0000", 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7868999999999997e-05 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238135+0000", 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1712000000000001e-05 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238143+0000", 2024-04-26T12:10:58.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:10:58.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238170+0000", 2024-04-26T12:10:58.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7560999999999999e-05 2024-04-26T12:10:58.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238260+0000", 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9912000000000002e-05 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:116588 5.b e36/17 5:d931b4e5:::benchmark_data_smithi045_43640_object116587:head v 36'7194, mlcod=36'7190)", 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.238501+0000", 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9998541, 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00040162299999999999, 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238501+0000", 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238501+0000", 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238501+0000", 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238555+0000", 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4707999999999999e-05 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238567+0000", 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1795e-05 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238575+0000", 2024-04-26T12:10:58.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6729999999999992e-06 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238678+0000", 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000103632 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.238695+0000", 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6818000000000001e-05 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116578 5.5 5:a9eec046:::benchmark_data_smithi045_43640_object116577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.232245+0000", 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0061097249999999999, 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067216919999999996, 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116578 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232245+0000", 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232245+0000", 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232245+0000", 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232310+0000", 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5256e-05 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232323+0000", 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2666e-05 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232332+0000", 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2189999999999993e-06 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232382+0000", 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0155999999999999e-05 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232525+0000", 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014260299999999999 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116579 5.7 5:e0a24c79:::benchmark_data_smithi045_43640_object116578:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.232344+0000", 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0060108260000000004, 2024-04-26T12:10:58.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006690802, 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116579 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232344+0000", 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232344+0000", 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232344+0000", 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232376+0000", 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2709999999999997e-05 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232385+0000", 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4659999999999999e-06 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.232391+0000", 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.438e-06 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233866+0000", 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014742589999999999 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233979+0000", 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011385800000000001 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116581 5.3 5:c3b36c0d:::benchmark_data_smithi045_43640_object116580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.233368+0000", 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0049873870000000002, 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057352519999999997, 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.292 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116581 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233368+0000", 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233368+0000", 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233367+0000", 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233422+0000", 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5358000000000001e-05 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233432+0000", 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:10:58.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233440+0000", 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7130000000000005e-06 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233484+0000", 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4351000000000003e-05 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.233623+0000", 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138706 2024-04-26T12:10:58.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:116582 5.b e36/17 5:de72971f:::benchmark_data_smithi045_43640_object116581:head v 36'7192, mlcod=36'7190)", 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.234774+0000", 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035812800000000001, 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043928719999999999, 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234774+0000", 2024-04-26T12:10:58.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234774+0000", 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234773+0000", 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234803+0000", 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0369999999999999e-05 2024-04-26T12:10:58.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234814+0000", 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0474e-05 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234820+0000", 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.246e-06 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234857+0000", 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6868e-05 2024-04-26T12:10:58.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234878+0000", 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0826999999999999e-05 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116584 5.c 5:33eed697:::benchmark_data_smithi045_43640_object116583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.234867+0000", 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0034886399999999999, 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043630270000000002, 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.299 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116584 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234867+0000", 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234867+0000", 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234866+0000", 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234892+0000", 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6681000000000001e-05 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234901+0000", 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8370000000000003e-06 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234914+0000", 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2751e-05 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.234959+0000", 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5247999999999998e-05 2024-04-26T12:10:58.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.235113+0000", 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000153232 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:10:58.303 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:58.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:58.305 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:58.303+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:58.405 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:58.404+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:58.509 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:58.506+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:58.535 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:58.535 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:10:58.535 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:10:58.535 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:10:58.536 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:58.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:10:58.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 46 16 117386 117370 159.453 137.625 0.00754177 0.00626792 2024-04-26T12:10:58.638 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:58.636+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:58.710 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:58.708+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:58.786 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.531946251000001, 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.787 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:10:58.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:10:58.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:10:58.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.977646530000001, 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.806142982000001, 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.799 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:58.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:10:58.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.804 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.314953951, 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:10:58.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:10:58.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.809 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.312602575, 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.813 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.310959704, 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:58.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.576585064, 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.818 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:10:58.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:10:58.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:10:58.822 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.576245798, 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:10:58.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.827 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.2995042919999999, 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:10:58.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:10:58.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:10:58.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.2962493150000007, 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.29375164, 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:10:58.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:10:58.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.2930683389999995, 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.2909478229999998, 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.845 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:58.849 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.2887338120000003, 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:10:58.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:10:58.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:104008 5.2 5:415023c7:::benchmark_data_smithi045_43640_object104007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.1335977589999997, 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019916103000000001, 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 104008 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649354+0000", 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1266999999999997e-05 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649363+0000", 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2199999999999998e-06 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649371+0000", 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658372+0000", 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090015549999999996 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658578+0000", 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020576599999999999 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669112+0000", 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010534094000000001 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669165+0000", 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669240+0000", 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4738000000000002e-05 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.858 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9231650010000001, 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:58.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:10:58.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:58.863 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8729395269999998, 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:10:58.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:10:58.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.7693249829999997, 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:10:58.868 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.6082342569999999, 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.873 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:10:58.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116404 5.3 5:cf638628:::benchmark_data_smithi045_43640_object116403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.63299326, 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020373558999999999, 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:10:58.878 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116404 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:10:58.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149927+0000", 2024-04-26T12:10:58.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:10:58.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:10:58.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149989+0000", 2024-04-26T12:10:58.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2156999999999995e-05 2024-04-26T12:10:58.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150000+0000", 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0348e-05 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150007+0000", 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1709999999999996e-06 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152529+0000", 2024-04-26T12:10:58.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025221470000000002 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152672+0000", 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014300200000000001 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170157+0000", 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017484911999999998 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170221+0000", 2024-04-26T12:10:58.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4614000000000002e-05 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170302+0000", 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0153000000000003e-05 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:10:58.884 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:10:58.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:10:58.886 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:58.884+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:58.986 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:58.986+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:59.015 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118424 5.b 5:d2ee0525:::benchmark_data_smithi045_43640_object118423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.068084+0000", 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0036110159999999999, 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036306049999999999, 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.073 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118424 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068084+0000", 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068084+0000", 2024-04-26T12:10:59.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068083+0000", 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068149+0000", 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5751000000000001e-05 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068157+0000", 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.593e-06 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068162+0000", 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1680000000000003e-06 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.069139+0000", 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00097761300000000001 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.069249+0000", 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011013700000000001 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.069389+0000", 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013935400000000001 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118428 5.8 5:17632dc4:::benchmark_data_smithi045_43640_object118427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.077 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.069936+0000", 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0017591130000000001, 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001829645, 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118428 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.069936+0000", 2024-04-26T12:10:59.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.069936+0000", 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.069935+0000", 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070042+0000", 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107093 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070054+0000", 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2119999999999999e-05 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070062+0000", 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0679999999999997e-06 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:59.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070099+0000", 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6452000000000003e-05 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070228+0000", 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012883999999999999 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070633+0000", 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00040566300000000001 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118431 5.e 5:7e56ee16:::benchmark_data_smithi045_43640_object118430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.070254+0000", 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001441138, 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0015560039999999999, 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118431 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070254+0000", 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070254+0000", 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070253+0000", 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:59.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070316+0000", 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2799000000000006e-05 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070325+0000", 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9409999999999996e-06 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070331+0000", 2024-04-26T12:10:59.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4409999999999998e-06 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070378+0000", 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6660999999999999e-05 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070517+0000", 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013914400000000001 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070661+0000", 2024-04-26T12:10:59.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000144 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118433 5.b 5:d3cb84f2:::benchmark_data_smithi045_43640_object118432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.070796+0000", 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00089834699999999997, 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010676959999999999, 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.086 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118433 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070796+0000", 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070796+0000", 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070796+0000", 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070870+0000", 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4715000000000005e-05 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070881+0000", 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0165e-05 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070888+0000", 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3610000000000003e-06 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071036+0000", 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014775500000000001 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071139+0000", 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103657 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071224+0000", 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4402999999999998e-05 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118434 5.0 5:074c0054:::benchmark_data_smithi045_43640_object118433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.070978+0000", 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00071720200000000001, 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00092902499999999999, 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.090 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118434 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070978+0000", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070978+0000", 2024-04-26T12:10:59.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070977+0000", 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071013+0000", 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5824999999999997e-05 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071026+0000", 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2962999999999999e-05 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071032+0000", 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071104+0000", 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2267000000000005e-05 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071185+0000", 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0328999999999996e-05 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071293+0000", 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000108428 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118435 5.8 5.7d56f348 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.071068+0000", 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00062718400000000003, 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00087785200000000004, 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118435 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071068+0000", 2024-04-26T12:10:59.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071068+0000", 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071067+0000", 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071095+0000", 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7599000000000001e-05 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071102+0000", 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.071108+0000", 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0739999999999998e-06 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.097 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:118420 5.b 5:d164d975:::benchmark_data_smithi045_43640_object118419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:59.066400+0000", 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.005295063, 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055787079999999999, 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 118420 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.098 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.066400+0000", 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.066400+0000", 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.066399+0000", 2024-04-26T12:10:59.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.066467+0000", 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7788999999999998e-05 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.066473+0000", 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7810000000000002e-06 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:10:59.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.066477+0000", 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.067886+0000", 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001409441 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.067989+0000", 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102818 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.068074+0000", 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4369999999999994e-05 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:59.070703+0000", 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026292490000000002 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 7 2024-04-26T12:10:59.102 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:10:59.104 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:10:59.104 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:59.102+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:59.190 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:10:59.205 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:59.204+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:59.211 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:10:59.211 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:10:59.211 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:10:59.211 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:10:59.214 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:10:59.214 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:10:59.307 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:59.305+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:59.322 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:59.322 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:59.337 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:10:59.422 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:59.421+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:59.507 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:59.506+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:59.556 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:59.556 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:59.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:10:59.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 47 16 119657 119641 159.08 141.938 0.00245675 0.0062829 2024-04-26T12:10:59.614 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:59.613+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:59.709 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:59.708+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:59.762 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:59.762 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:59.777 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:10:59.809 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:10:59.808+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:10:59.911 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:10:59.910+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:10:59.965 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:10:59.965 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:10:59.979 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:00.011 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:00.010+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:00.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-26T12:11:00.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:11:00.115 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:00.114+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:00.225 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:00.225 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:00.227 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:00.224+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:00.232 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:00.318 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:00.317+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:00.412 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:00.413 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:00.419 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:00.418+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:00.427 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:00.520 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:00.519+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:00.600 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:00.601 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:00.607 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 48 16 121853 121837 158.625 137.25 0.00564799 0.0063005 2024-04-26T12:11:00.617 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:00.658 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:00.657+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:00.721 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:00.720+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:00.823 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:00.821+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:00.837 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:00.837 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:00.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:00.923 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:00.922+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.024 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:01.023+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:01.039 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:01.039 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:01.052 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:11:01.124 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:01.123+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:01.215 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:01.226 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.225+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.286 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:01.286 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:01.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:01.343 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.342+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.398 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:01.421 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:01.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:01.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:01.431 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.427+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.530 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.529+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.279855027, 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:01.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:01.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.725555306, 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.540 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:11:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:11:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:11:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.554051758, 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:01.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:01.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:01.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.554 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.062862726999999, 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.555 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:01.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.060511350999999, 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:01.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:01.564 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.058868480000001, 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:01.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.324493840000001, 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.569 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:11:01.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:11:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:11:01.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:01.574 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.324154574, 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:11:01.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:11:01.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:11:01.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.047413068000001, 2024-04-26T12:11:01.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:01.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.044158091, 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:01.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:01.588 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.041660415999999, 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:01.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.040977115, 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:01.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:01.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.038856599000001, 2024-04-26T12:11:01.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:01.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:01.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.036642587999999, 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:104008 5.2 5:415023c7:::benchmark_data_smithi045_43640_object104007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8815065349999998, 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019916103000000001, 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.607 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 104008 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:01.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649354+0000", 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1266999999999997e-05 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649363+0000", 2024-04-26T12:11:01.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2199999999999998e-06 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649371+0000", 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658372+0000", 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090015549999999996 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658578+0000", 2024-04-26T12:11:01.610 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020576599999999999 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669112+0000", 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010534094000000001 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669165+0000", 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669240+0000", 2024-04-26T12:11:01.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4738000000000002e-05 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.6710737770000001, 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.612 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:11:01.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:11:01.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:11:01.616 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.617 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.617 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.617 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:01.617 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.6208483029999998, 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.618 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:11:01.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.5172337589999998, 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.623 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:01.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3561430330000004, 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.628 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:01.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:01.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:01.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116404 5.3 5:cf638628:::benchmark_data_smithi045_43640_object116403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.3809020360000002, 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020373558999999999, 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.633 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116404 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149927+0000", 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149989+0000", 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2156999999999995e-05 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150000+0000", 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0348e-05 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150007+0000", 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1709999999999996e-06 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152529+0000", 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025221470000000002 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152672+0000", 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014300200000000001 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170157+0000", 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017484911999999998 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170221+0000", 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4614000000000002e-05 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170302+0000", 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0153000000000003e-05 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.637 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.638 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:01.638 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:01.638 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:01.638 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T12:11:01.638 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:11:01.638 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-26T12:11:01.638 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:11:01.638 INFO:teuthology.orchestra.console.smithi071:Power on 2024-04-26T12:11:01.638 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T12:11:01.651 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 49 16 124028 124012 158.162 135.938 0.00433239 0.00631944 2024-04-26T12:11:01.652 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.650+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.653 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:01.663 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2024-04-26T12:11:01.663 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:11:01.687 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-04-26T12:11:01.752 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.751+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:01.838 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124533 5.0 5:0f1499db:::benchmark_data_smithi045_43640_object124532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.833119+0000", 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0039873790000000001, 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040158989999999999, 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.839 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124533 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833119+0000", 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833119+0000", 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833118+0000", 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833182+0000", 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3657000000000004e-05 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833191+0000", 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4770000000000003e-06 2024-04-26T12:11:01.841 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833197+0000", 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833253+0000", 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5578999999999998e-05 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833380+0000", 2024-04-26T12:11:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127639 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833523+0000", 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000142266 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124534 5.f 5:ffa71b65:::benchmark_data_smithi045_43640_object124533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.833209+0000", 2024-04-26T12:11:01.843 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0038976000000000002, 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039831149999999997, 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124534 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833209+0000", 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833209+0000", 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833208+0000", 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833873+0000", 2024-04-26T12:11:01.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00066508400000000003 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833886+0000", 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.257e-05 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833893+0000", 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1640000000000004e-06 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.846 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835297+0000", 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014037330000000001 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835399+0000", 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102619 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124535 5.4 5:27452a96:::benchmark_data_smithi045_43640_object124534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.833903+0000", 2024-04-26T12:11:01.847 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0032030439999999999, 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033332790000000002, 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124535 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833903+0000", 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833903+0000", 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833903+0000", 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833933+0000", 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833941+0000", 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2740000000000007e-06 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833947+0000", 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3940000000000004e-06 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833995+0000", 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7987e-05 2024-04-26T12:11:01.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834122+0000", 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012683 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834267+0000", 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014558999999999999 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.836752+0000", 2024-04-26T12:11:01.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024843909999999999 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124537 5.e 5:77fa42b9:::benchmark_data_smithi045_43640_object124536:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.833956+0000", 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00315059, 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003329636, 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124537 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833956+0000", 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833956+0000", 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833955+0000", 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833985+0000", 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9981e-05 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833992+0000", 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833997+0000", 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8470000000000003e-06 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835278+0000", 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001281246 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835356+0000", 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8042999999999998e-05 2024-04-26T12:11:01.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835472+0000", 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000115773 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124539 5.f 5:f1cc72bc:::benchmark_data_smithi045_43640_object124538:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.834004+0000", 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0031022340000000002, 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033431530000000002, 2024-04-26T12:11:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124539 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834004+0000", 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.857 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834004+0000", 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834004+0000", 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834033+0000", 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8903000000000001e-05 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834039+0000", 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.37e-06 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834044+0000", 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7759999999999997e-06 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837326+0000", 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032821460000000001 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.859 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124540 5.8 5:1ecd017a:::benchmark_data_smithi045_43640_object124539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.834048+0000", 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003058116, 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033508040000000002, 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124540 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834048+0000", 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834048+0000", 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834048+0000", 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834075+0000", 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7016999999999999e-05 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834081+0000", 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1449999999999996e-06 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834086+0000", 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8899999999999998e-06 2024-04-26T12:11:01.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835214+0000", 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00112784 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835334+0000", 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012006900000000001 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.835465+0000", 2024-04-26T12:11:01.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013133099999999999 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124541 5.e 5:783b7799:::benchmark_data_smithi045_43640_object124540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.834234+0000", 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0028718889999999999, 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032427910000000001, 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.864 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124541 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834234+0000", 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834234+0000", 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834234+0000", 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834322+0000", 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8647999999999996e-05 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834330+0000", 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9230000000000002e-06 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.834336+0000", 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1179999999999997e-06 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837105+0000", 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0027686239999999999 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837257+0000", 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000151865 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837378+0000", 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000120856 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124544 5.e 5.213c5e5e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.837318+0000", 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997888, 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00024806699999999998, 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:01.868 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124544 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837318+0000", 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837318+0000", 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837316+0000", 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837413+0000", 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6776999999999999e-05 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837424+0000", 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1297999999999999e-05 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837433+0000", 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2449999999999998e-06 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.871 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124545 5.f 5.885b4dcf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.837470+0000", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9996367, 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013797599999999999, 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124545 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837470+0000", 2024-04-26T12:11:01.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837470+0000", 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837469+0000", 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837533+0000", 2024-04-26T12:11:01.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4386000000000003e-05 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837542+0000", 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0850000000000003e-06 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.837549+0000", 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.55e-06 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124527 5.e 5:7b5a3539:::benchmark_data_smithi045_43640_object124526:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.832798+0000", 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0043085179999999999, 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048512720000000002, 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124527 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832798+0000", 2024-04-26T12:11:01.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832798+0000", 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832797+0000", 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832860+0000", 2024-04-26T12:11:01.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3445e-05 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832872+0000", 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1368e-05 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832879+0000", 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7190000000000001e-06 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832909+0000", 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0137999999999998e-05 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833007+0000", 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7442000000000007e-05 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833114+0000", 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107157 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.879 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:124530 5.f 5:f832a199:::benchmark_data_smithi045_43640_object124529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:01.832890+0000", 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0042164200000000002, 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048072619999999996, 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 124530 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.880 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832890+0000", 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832890+0000", 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832889+0000", 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:01.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832958+0000", 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8548999999999997e-05 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832964+0000", 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0299999999999999e-06 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832970+0000", 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1070000000000001e-06 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.832996+0000", 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5732e-05 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:01.833088+0000", 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2057000000000003e-05 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:01.884 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:01.884 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 11 2024-04-26T12:11:01.884 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:01.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:01.886 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:01.884+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:01.986 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:01.985+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:02.086 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:02.085+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:02.093 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:02.093 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:02.093 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:02.093 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:02.093 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:02.107 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:02.187 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:02.186+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:02.288 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:02.287+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:02.329 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:02.329 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:48065 5.e 5:73f2922c:::benchmark_data_smithi045_43640_object48064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.402450590999997, 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019784495999999999, 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 48065 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923678+0000", 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923717+0000", 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9079999999999999e-05 2024-04-26T12:11:02.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923722+0000", 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8670000000000002e-06 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.923725+0000", 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.23e-06 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927427+0000", 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037022090000000001 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927509+0000", 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1493000000000001e-05 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.927591+0000", 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2657999999999994e-05 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.930774+0000", 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031828870000000001 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943394+0000", 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.012619274 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943438+0000", 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4289999999999998e-05 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:26.943463+0000", 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4774999999999999e-05 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.79884023, 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:11:02.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:11:02.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:11:02.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:78400 5.4 5:298bb304:::benchmark_data_smithi045_43640_object78399:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.168882028999999, 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019529787, 2024-04-26T12:11:02.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 78400 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157247+0000", 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157246+0000", 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157288+0000", 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1885000000000003e-05 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157295+0000", 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.157300+0000", 2024-04-26T12:11:02.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0989999999999998e-06 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159342+0000", 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020422750000000001 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159466+0000", 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012425000000000001 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.159608+0000", 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141738 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.162201+0000", 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002592652 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176711+0000", 2024-04-26T12:11:02.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014510383999999999 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176744+0000", 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2252999999999998e-05 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:40.176777+0000", 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3024000000000001e-05 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.349 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 16.857781946999999, 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.350 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:02.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:02.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 16.856166704, 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:02.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:02.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.363 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 16.853802409, 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:02.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:02.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:02.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:02.371 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.939751096, 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:02.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.378 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96735 5.b 5:de09d9e8:::benchmark_data_smithi045_43640_object96734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.935041935999999, 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020069007, 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96735 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391086+0000", 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391144+0000", 2024-04-26T12:11:02.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8223000000000001e-05 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391155+0000", 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0530000000000001e-05 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391170+0000", 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4722999999999999e-05 2024-04-26T12:11:02.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391287+0000", 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117304 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391381+0000", 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3951999999999998e-05 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391470+0000", 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9425999999999994e-05 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392922+0000", 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001451665 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411075+0000", 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018153385000000001 2024-04-26T12:11:02.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411120+0000", 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4799999999999998e-05 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411156+0000", 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5728000000000001e-05 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.845071516000001, 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.386 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:02.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:02.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.839863745000001, 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:02.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:02.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:02.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.399 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.836664787, 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:02.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.405 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.836412979, 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.406 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:02.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.412 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.833756941000001, 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:02.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:02.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:02.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.832250172, 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:02.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:02.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:02.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:02.425 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.829639718999999, 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:02.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114401 5.b 5:d2c6df93:::benchmark_data_smithi045_43640_object114400:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.0628663759999997, 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019964612, 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.432 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114401 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263262+0000", 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263287+0000", 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4953999999999999e-05 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263292+0000", 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263296+0000", 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.318e-06 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263336+0000", 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0153e-05 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263468+0000", 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000132137 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.263607+0000", 2024-04-26T12:11:02.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013891899999999999 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.265717+0000", 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021101660000000001 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.283144+0000", 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017426754999999999 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.283190+0000", 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6383e-05 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.283227+0000", 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6677000000000001e-05 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.98303706, 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:02.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:116265 5.b 5:d0dab8b8:::benchmark_data_smithi045_43640_object116264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.2466432740000002, 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020066792, 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.445 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 116265 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079485+0000", 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079557+0000", 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2298999999999993e-05 2024-04-26T12:11:02.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079565+0000", 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079571+0000", 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079782+0000", 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000211151 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079878+0000", 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6039999999999995e-05 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079970+0000", 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1728e-05 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.081597+0000", 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016275899999999999 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099457+0000", 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017860034 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099504+0000", 2024-04-26T12:11:02.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6916000000000003e-05 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099552+0000", 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8068999999999997e-05 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:116266 5.8 5:1c80649b:::benchmark_data_smithi045_43640_object116265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:58.079578+0000", 2024-04-26T12:11:02.451 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.2465510760000003, 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019986483999999999, 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 116266 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079578+0000", 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079578+0000", 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079577+0000", 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079614+0000", 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6641999999999999e-05 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079621+0000", 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1189999999999999e-06 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079626+0000", 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.22e-06 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079660+0000", 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4258999999999998e-05 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079783+0000", 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012239 2024-04-26T12:11:02.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079922+0000", 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013914400000000001 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.082202+0000", 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022798670000000001 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099508+0000", 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017306206000000001 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099541+0000", 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2568999999999999e-05 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099564+0000", 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3527999999999999e-05 2024-04-26T12:11:02.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.031577935000000001, 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:02.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:02.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:02.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:02.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:02.464 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:02.466 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:02.467 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:02.464+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:02.566 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:02.565+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:02.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 50 15 126327 126312 157.873 143.75 0.00902677 0.00633093 2024-04-26T12:11:02.663 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:02.663 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:02.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.663 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126418 5.1 5:81ca0867:::benchmark_data_smithi045_43640_object126417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.663 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.653820+0000", 2024-04-26T12:11:02.663 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0070275010000000002, 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0070557750000000002, 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126418 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.653820+0000", 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.653820+0000", 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.653819+0000", 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.653882+0000", 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3314999999999999e-05 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.653893+0000", 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.045e-05 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.653900+0000", 2024-04-26T12:11:02.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5869999999999998e-06 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654464+0000", 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000564107 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654590+0000", 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012634699999999999 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126420 5.1 5:86c05e39:::benchmark_data_smithi045_43640_object126419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.654268+0000", 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065801050000000002, 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066992830000000003, 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126420 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654268+0000", 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654268+0000", 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654267+0000", 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654410+0000", 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143146 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654421+0000", 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0845999999999999e-05 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654428+0000", 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3390000000000004e-06 2024-04-26T12:11:02.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656963+0000", 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025346980000000002 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657117+0000", 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015445300000000001 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:126417 5.4 e37/17 5:24e242ef:::benchmark_data_smithi045_43640_object126416:head v 37'8025, mlcod=37'8019)", 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.654333+0000", 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065150690000000001, 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067045910000000002, 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654333+0000", 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654333+0000", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654332+0000", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654440+0000", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108169 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654451+0000", 2024-04-26T12:11:02.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0339e-05 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654458+0000", 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3830000000000003e-06 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656370+0000", 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019123370000000001 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656393+0000", 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2529999999999999e-05 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126421 5.7 5:ee2a938e:::benchmark_data_smithi045_43640_object126420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.654436+0000", 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0064115079999999998, 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066825599999999997, 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126421 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654436+0000", 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654436+0000", 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654436+0000", 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654483+0000", 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7314000000000001e-05 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654490+0000", 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1550000000000001e-06 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654497+0000", 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654543+0000", 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6703999999999999e-05 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654672+0000", 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012875899999999999 2024-04-26T12:11:02.678 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126422 5.7 5:e017ca54:::benchmark_data_smithi045_43640_object126421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.654512+0000", 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0063362540000000004, 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066942049999999999, 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126422 2024-04-26T12:11:02.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654512+0000", 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654512+0000", 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654511+0000", 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654545+0000", 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3612000000000003e-05 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654559+0000", 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4270000000000001e-05 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654565+0000", 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4330000000000001e-06 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.658782+0000", 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042169809999999999 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.658911+0000", 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012860200000000001 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:126423 5.e e37/17 5:7e7449e4:::benchmark_data_smithi045_43640_object126422:head v 37'7907, mlcod=37'7905)", 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.654856+0000", 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0059921260000000004, 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0064176429999999998, 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654856+0000", 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654856+0000", 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654855+0000", 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654910+0000", 2024-04-26T12:11:02.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4635999999999997e-05 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654921+0000", 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1314999999999999e-05 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654928+0000", 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.511e-06 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654959+0000", 2024-04-26T12:11:02.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0938000000000001e-05 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.654972+0000", 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3205e-05 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126425 5.1 5:839510bb:::benchmark_data_smithi045_43640_object126424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.656904+0000", 2024-04-26T12:11:02.686 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039435319999999996, 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0044399579999999999, 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126425 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656904+0000", 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656904+0000", 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656903+0000", 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656938+0000", 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5159e-05 2024-04-26T12:11:02.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656954+0000", 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5715000000000001e-05 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656961+0000", 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1539999999999996e-06 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.658992+0000", 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020312960000000001 2024-04-26T12:11:02.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659109+0000", 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000116758 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126426 5.2 5:44b4b04a:::benchmark_data_smithi045_43640_object126425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.656971+0000", 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0038764289999999998, 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004444389, 2024-04-26T12:11:02.690 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126426 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656971+0000", 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656971+0000", 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656971+0000", 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.656999+0000", 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8493e-05 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657006+0000", 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8619999999999997e-06 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657012+0000", 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0530000000000003e-06 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657050+0000", 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7696e-05 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657194+0000", 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143802 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126427 5.a 5:5cc28c9f:::benchmark_data_smithi045_43640_object126426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.657023+0000", 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0038253559999999998, 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0044695619999999998, 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.694 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126427 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657023+0000", 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657023+0000", 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657022+0000", 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657051+0000", 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8595e-05 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657060+0000", 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9910000000000008e-06 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657065+0000", 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5960000000000003e-06 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657127+0000", 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1937e-05 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657249+0000", 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000121673 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657429+0000", 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000180445 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126428 5.a 5:58df48bc:::benchmark_data_smithi045_43640_object126427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.657283+0000", 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035653669999999998, 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004299949, 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126428 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657283+0000", 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657283+0000", 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657282+0000", 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657356+0000", 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3830000000000003e-05 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657364+0000", 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4679999999999992e-06 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657370+0000", 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5620000000000003e-06 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659341+0000", 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019715520000000001 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659454+0000", 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000112825 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659587+0000", 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000132786 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126429 5.1 5.f7e1eb01 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.657378+0000", 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0034700019999999998, 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042826590000000003, 2024-04-26T12:11:02.702 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126429 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657378+0000", 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657378+0000", 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657377+0000", 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657401+0000", 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3198999999999999e-05 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657405+0000", 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6199999999999998e-06 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.657409+0000", 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:126430 5.a 5:5c3affb4:::benchmark_data_smithi045_43640_object126429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.659229+0000", 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0016187630000000001, 2024-04-26T12:11:02.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024963730000000001, 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 126430 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659229+0000", 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659229+0000", 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659228+0000", 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659274+0000", 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5858e-05 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659285+0000", 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1049e-05 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659293+0000", 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.858e-06 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661494+0000", 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022006460000000001 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661625+0000", 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013160299999999999 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:126427 5.a e37/17)", 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.659332+0000", 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0015158039999999999, 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024659959999999998, 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659332+0000", 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659332+0000", 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659331+0000", 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659337+0000", 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3589999999999999e-06 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659347+0000", 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0032e-05 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.659354+0000", 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.277e-06 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:126431 5.0 e37/17 5:02094f2d:::benchmark_data_smithi045_43640_object126430:head v 37'7910, mlcod=37'7907)", 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.660237+0000", 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00061058800000000002, 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001648048, 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660237+0000", 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660237+0000", 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660237+0000", 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660299+0000", 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2434000000000006e-05 2024-04-26T12:11:02.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660309+0000", 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6600000000000007e-06 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660315+0000", 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4919999999999998e-06 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660341+0000", 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5897999999999998e-05 2024-04-26T12:11:02.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.660354+0000", 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2561000000000001e-05 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:126428 5.a e37/17)", 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:02.661147+0000", 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9997005, 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00080275099999999999, 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:02.715 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661147+0000", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661147+0000", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661147+0000", 2024-04-26T12:11:02.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661151+0000", 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.031e-06 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661159+0000", 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9910000000000002e-06 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:02.661164+0000", 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7720000000000002e-06 2024-04-26T12:11:02.717 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.718 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:02.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:02.718 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:02.718 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 15 2024-04-26T12:11:02.718 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:02.719 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:02.720 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:02.718+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:02.819 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:02.819+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:02.922 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:02.920+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:02.959 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:02.959 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:02.959 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:02.959 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:02.959 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:02.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:03.021 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:03.021+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:03.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:11:03.122 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:03.121+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.954139101999999, 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.210 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:03.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.217 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:11:03.217 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:03.217 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.399839381, 2024-04-26T12:11:03.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:11:03.217 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.217 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:11:03.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:11:03.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:11:03.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:11:03.223 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.223 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.223 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 23.228335832999999, 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.224 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:03.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.737146802000002, 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.230 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.235 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.734795426000002, 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.239 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.733152555, 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:03.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:03.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.998777915, 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:11:03.244 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:11:03.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:11:03.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.998438649000001, 2024-04-26T12:11:03.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:11:03.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:11:03.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.721697143, 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:03.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.718442165999999, 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:03.259 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:03.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.263 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.715944491, 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:03.268 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.71526119, 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:03.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.272 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.713140674, 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:03.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:03.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.710926663, 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:03.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:03.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:104008 5.2 5:415023c7:::benchmark_data_smithi045_43640_object104007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:03.281 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.555790610000001, 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019916103000000001, 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 104008 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649354+0000", 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1266999999999997e-05 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649363+0000", 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2199999999999998e-06 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649371+0000", 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658372+0000", 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090015549999999996 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658578+0000", 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020576599999999999 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669112+0000", 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010534094000000001 2024-04-26T12:11:03.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669165+0000", 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669240+0000", 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4738000000000002e-05 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.3453578519999994, 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:03.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:11:03.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:11:03.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:03.291 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.2951323779999999, 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:11:03.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:11:03.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.296 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.1915178340000008, 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:11:03.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.0304271079999996, 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.302 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:03.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:03.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116404 5.3 5:cf638628:::benchmark_data_smithi045_43640_object116403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.0551861110000003, 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020373558999999999, 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116404 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.308 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:03.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149927+0000", 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149989+0000", 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2156999999999995e-05 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150000+0000", 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0348e-05 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150007+0000", 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1709999999999996e-06 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152529+0000", 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025221470000000002 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152672+0000", 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014300200000000001 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170157+0000", 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017484911999999998 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170221+0000", 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4614000000000002e-05 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:03.312 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170302+0000", 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0153000000000003e-05 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:03.313 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:03.315 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:03.315 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:03.313+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:03.415 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:03.414+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:03.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:03.495 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:128277 5.e 5:7bbe2ceb:::benchmark_data_smithi045_43640_object128276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.491424+0000", 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0028861529999999998, 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029118550000000001, 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:03.496 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 128277 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491424+0000", 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491424+0000", 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491422+0000", 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491488+0000", 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5419000000000005e-05 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491496+0000", 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.303e-06 2024-04-26T12:11:03.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491502+0000", 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491537+0000", 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.506e-05 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491623+0000", 2024-04-26T12:11:03.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5921999999999995e-05 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491745+0000", 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012173299999999999 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:128279 5.b 5:d938d2cd:::benchmark_data_smithi045_43640_object128278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.491819+0000", 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.002490712, 2024-04-26T12:11:03.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002612451, 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 128279 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491819+0000", 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491819+0000", 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491818+0000", 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491877+0000", 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8696000000000002e-05 2024-04-26T12:11:03.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491893+0000", 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.6144e-05 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491900+0000", 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0029999999999997e-06 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491963+0000", 2024-04-26T12:11:03.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2395000000000001e-05 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492047+0000", 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4022000000000003e-05 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492128+0000", 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1718000000000006e-05 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:128281 5.b 5:dab96c41:::benchmark_data_smithi045_43640_object128280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.492515+0000", 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0017943919999999999, 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020032000000000001, 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 128281 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492515+0000", 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492515+0000", 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492515+0000", 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492631+0000", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116483 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492640+0000", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1779999999999992e-06 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.492646+0000", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6210000000000001e-06 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.493681+0000", 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010353249999999999 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.493775+0000", 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3381999999999995e-05 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.493882+0000", 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107604 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.508 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:128280 5.a e37/17 5:54c6204b:::benchmark_data_smithi045_43640_object128279:head v 37'7940, mlcod=37'7937)", 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.494123+0000", 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00018682799999999999, 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00048480000000000002, 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494123+0000", 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494123+0000", 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494123+0000", 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494163+0000", 2024-04-26T12:11:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0636999999999997e-05 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494171+0000", 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8339999999999999e-06 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494176+0000", 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9760000000000003e-06 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494208+0000", 2024-04-26T12:11:03.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1489000000000003e-05 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494227+0000", 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8941e-05 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:128284 5.f 5:f3788cbb:::benchmark_data_smithi045_43640_object128283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.494117+0000", 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.000192377, 2024-04-26T12:11:03.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00055965400000000003, 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 128284 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494117+0000", 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494117+0000", 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494117+0000", 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494212+0000", 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5747000000000003e-05 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494222+0000", 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0489999999999993e-06 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494229+0000", 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3660000000000003e-06 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494266+0000", 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6862e-05 2024-04-26T12:11:03.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.494409+0000", 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014302600000000001 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:128271 5.0 5:043261fd:::benchmark_data_smithi045_43640_object128270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.487845+0000", 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.006464872, 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.006903574, 2024-04-26T12:11:03.516 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 128271 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.487845+0000", 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.487845+0000", 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.487844+0000", 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.487992+0000", 2024-04-26T12:11:03.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000148107 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488001+0000", 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488008+0000", 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.241e-06 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488043+0000", 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5763999999999998e-05 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488154+0000", 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110534 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488282+0000", 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012809200000000001 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490954+0000", 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026720870000000001 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:128272 5.f 5:f956e0d6:::benchmark_data_smithi045_43640_object128271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.488015+0000", 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0062946549999999997, 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.006823183, 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:03.521 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 128272 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488015+0000", 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488015+0000", 2024-04-26T12:11:03.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488015+0000", 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488103+0000", 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7928000000000002e-05 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488110+0000", 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3950000000000003e-06 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.488115+0000", 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3990000000000003e-06 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491671+0000", 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035554060000000001 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.491807+0000", 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136069 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:128273 5.a e37/17 5:528bdb84:::benchmark_data_smithi045_43640_object128272:head v 37'7939, mlcod=37'7937)", 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.490191+0000", 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0041186759999999999, 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0047188760000000003, 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490191+0000", 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490191+0000", 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490190+0000", 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:03.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490221+0000", 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0349999999999999e-05 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490232+0000", 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0871e-05 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490239+0000", 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1600000000000001e-06 2024-04-26T12:11:03.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490278+0000", 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.913e-05 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.490306+0000", 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7914000000000001e-05 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:03.528 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:03.529 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 8 2024-04-26T12:11:03.529 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:03.530 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:03.529+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:03.531 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:03.594 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:03.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 51 16 128555 128539 157.507 139.188 0.00537459 0.00634573 2024-04-26T12:11:03.615 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:03.618 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:03.618 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:03.631 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:03.630+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:03.731 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:03.730+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:03.750 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:03.750 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:03.763 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:03.833 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:03.832+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:03.934 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:03.933+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:03.938 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:03.938 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:03.955 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:04.034 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:04.033+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:04.065 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:11:04.135 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:04.134+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:04.156 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:04.156 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:04.171 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:04.237 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:04.236+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:04.337 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:04.336+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:04.362 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:04.362 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:04.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:04.438 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:04.437+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:04.539 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:04.538+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:04.608 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:04.608 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:04.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 52 16 130719 130703 157.078 135.25 0.00584077 0.00636251 2024-04-26T12:11:04.623 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:04.640 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:04.639+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:04.741 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:04.740+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:04.798 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:04.798 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:04.811 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:04.854 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:04.851+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:04.942 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:04.941+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:05.029 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:05.029 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:05.042 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:05.044 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:05.042+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:05.144 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:05.143+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:05.228 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:05.228 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:05.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:05.245 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:05.244+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:05.346 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:05.345+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:05.434 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:05.434 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:05.447 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:05.446+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:05.449 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:05.548 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:05.547+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:05.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 53 16 132960 132944 156.757 140.062 0.00824659 0.00637614 2024-04-26T12:11:05.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:05.649 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:05.648+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:05.683 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:05.683 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:05.689 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:11:05.700 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:05.785 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:05.784+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:05.791 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:05.799 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-04-26T12:11:05.813 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:05.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:05.817 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:05.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-04-26T12:11:05.850 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:05.849+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:05.929 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.675593133, 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.930 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:05.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:05.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.121293412, 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 25.949789864, 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.941 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:05.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 20.458600832999998, 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:05.951 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 20.456249456999998, 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:05.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:05.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:05.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 20.454606586000001, 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.959 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.720231945999998, 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:11:05.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:05.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.964 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.719892680000001, 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.969 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.443151174, 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:05.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:05.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:05.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:05.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.439896196999999, 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.437398521999999, 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.982 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.436715221, 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:05.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.434594704999999, 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.987 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:05.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:05.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 16.432380693999999, 2024-04-26T12:11:05.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.995 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:104008 5.2 5:415023c7:::benchmark_data_smithi045_43640_object104007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.277244640999999, 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019916103000000001, 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 104008 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649323+0000", 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649354+0000", 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1266999999999997e-05 2024-04-26T12:11:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649363+0000", 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2199999999999998e-06 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.649371+0000", 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3089999999999998e-06 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658372+0000", 2024-04-26T12:11:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090015549999999996 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.658578+0000", 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00020576599999999999 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669112+0000", 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010534094000000001 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669165+0000", 2024-04-26T12:11:05.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2759000000000001e-05 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:52.669240+0000", 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4738000000000002e-05 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.066811883, 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:11:06.000 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:06.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:06.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:06.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.016586409, 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:06.005 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:11:06.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:11:06.009 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 11.912971864999999, 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:06.010 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:06.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.751881139, 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:06.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:06.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116404 5.3 5:cf638628:::benchmark_data_smithi045_43640_object116403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 7.7766401419999998, 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020373558999999999, 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116404 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:06.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149927+0000", 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149989+0000", 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2156999999999995e-05 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150000+0000", 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0348e-05 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150007+0000", 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1709999999999996e-06 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152529+0000", 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025221470000000002 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152672+0000", 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014300200000000001 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170157+0000", 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017484911999999998 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170221+0000", 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4614000000000002e-05 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170302+0000", 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0153000000000003e-05 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:06.024 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:06.026 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:06.024+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:06.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:06.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:11:06.129 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:06.126+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:06.201 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:06.201 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:134229 5.9 5:98476aa4:::benchmark_data_smithi045_43640_object134228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:06.199749+0000", 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00066972699999999995, 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00069297200000000003, 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 134229 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199749+0000", 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199749+0000", 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199748+0000", 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199799+0000", 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0958999999999998e-05 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199808+0000", 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7159999999999998e-06 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199816+0000", 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0839999999999992e-06 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199855+0000", 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8121000000000003e-05 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199953+0000", 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8715000000000006e-05 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:134213 5.e 5:7ec60642:::benchmark_data_smithi045_43640_object134212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:06.194865+0000", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0055534929999999996, 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.005625311, 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 134213 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.194865+0000", 2024-04-26T12:11:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.209 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.209 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.209 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.194865+0000", 2024-04-26T12:11:06.209 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.194864+0000", 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.194981+0000", 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116587 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.194993+0000", 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1904e-05 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195003+0000", 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.764e-06 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195029+0000", 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6863999999999999e-05 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.211 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195110+0000", 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0847999999999996e-05 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195198+0000", 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7916000000000003e-05 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199243+0000", 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040448319999999999 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:134215 5.e 5:708fb00f:::benchmark_data_smithi045_43640_object134214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:06.195013+0000", 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0054058730000000003, 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0055251229999999998, 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 134215 2024-04-26T12:11:06.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195013+0000", 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195013+0000", 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195012+0000", 2024-04-26T12:11:06.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195078+0000", 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5844000000000002e-05 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195088+0000", 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0335e-05 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195095+0000", 2024-04-26T12:11:06.215 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.934e-06 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.197300+0000", 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022046240000000001 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.197423+0000", 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012314699999999999 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.197570+0000", 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014711699999999999 2024-04-26T12:11:06.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.199585+0000", 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020147400000000001 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:134217 5.0 5:0f296dc5:::benchmark_data_smithi045_43640_object134216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:06.195103+0000", 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0053156640000000003, 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0054814340000000003, 2024-04-26T12:11:06.217 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 134217 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195103+0000", 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.218 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195103+0000", 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195102+0000", 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195186+0000", 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3308999999999998e-05 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195195+0000", 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3090000000000001e-06 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195203+0000", 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.208e-06 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195229+0000", 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5873000000000001e-05 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195351+0000", 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012228200000000001 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195468+0000", 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011621900000000001 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.198453+0000", 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029853639999999999 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:134220 5.8 5:114aed76:::benchmark_data_smithi045_43640_object134219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:06.195260+0000", 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0051587159999999998, 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0053692619999999996, 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 134220 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.222 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195260+0000", 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195260+0000", 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195259+0000", 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195364+0000", 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010539099999999999 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195379+0000", 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4569000000000001e-05 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195386+0000", 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3080000000000002e-06 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.224 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195420+0000", 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3232000000000003e-05 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195522+0000", 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102367 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195648+0000", 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000126191 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.198440+0000", 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002791502 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:134221 5.b 5:dcabdbde:::benchmark_data_smithi045_43640_object134220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:06.195394+0000", 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.005024288, 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052790989999999998, 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.226 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 134221 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195394+0000", 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195394+0000", 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195394+0000", 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195475+0000", 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0895000000000004e-05 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195484+0000", 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1339999999999993e-06 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195490+0000", 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2659999999999998e-06 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195528+0000", 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8142999999999997e-05 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195640+0000", 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011153 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.195769+0000", 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012944200000000001 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:06.198472+0000", 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0027029580000000001 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 6 2024-04-26T12:11:06.230 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:06.232 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:06.231+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:06.232 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:06.333 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:06.332+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:06.434 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:06.432+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:06.445 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:06.446 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:06.446 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:06.446 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:06.446 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:06.458 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:06.534 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:06.533+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:06.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 54 16 135143 135127 156.381 136.438 0.00783545 0.00639135 2024-04-26T12:11:06.636 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:06.635+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:06.680 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:06.680 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:06.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.148353121, 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:11:06.681 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:11:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.683 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.683 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.683 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:06.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.684 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:06.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:11:06.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:11:06.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:11:06.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.688 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.688 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.688 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:11:06.688 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:11:06.688 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.689 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:11:06.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:11:06.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:11:06.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.692 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.207294837999999, 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.693 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:06.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.699 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.205679594999999, 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:06.700 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.701 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:06.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:06.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.706 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:06.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:06.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.2033153, 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.711 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:06.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:06.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:06.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.289263986999998, 2024-04-26T12:11:06.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:06.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:06.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:06.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96735 5.b 5:de09d9e8:::benchmark_data_smithi045_43640_object96734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.284554827000001, 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020069007, 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.723 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96735 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391086+0000", 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391144+0000", 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8223000000000001e-05 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391155+0000", 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0530000000000001e-05 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391170+0000", 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4722999999999999e-05 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391287+0000", 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117304 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391381+0000", 2024-04-26T12:11:06.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3951999999999998e-05 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391470+0000", 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9425999999999994e-05 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392922+0000", 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001451665 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411075+0000", 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018153385000000001 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411120+0000", 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4799999999999998e-05 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411156+0000", 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5728000000000001e-05 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.728 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.194584407000001, 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:06.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.734 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.189376635999999, 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:06.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:06.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:06.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.186177678, 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:06.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:06.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.745 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.185925869999998, 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:06.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:06.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.751 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.183269832000001, 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.752 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:06.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.757 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.181763062999998, 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:06.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:06.763 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.179152609999999, 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:06.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.3325499510000007, 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:06.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.774 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:116265 5.b 5:d0dab8b8:::benchmark_data_smithi045_43640_object116264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.596156165, 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020066792, 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 116265 2024-04-26T12:11:06.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079485+0000", 2024-04-26T12:11:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079557+0000", 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2298999999999993e-05 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079565+0000", 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079571+0000", 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079782+0000", 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000211151 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079878+0000", 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6039999999999995e-05 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079970+0000", 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1728e-05 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.081597+0000", 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016275899999999999 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099457+0000", 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017860034 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099504+0000", 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6916000000000003e-05 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099552+0000", 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8068999999999997e-05 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.780 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.3810908260000003, 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:06.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:06.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127196 5.e 5:7fe59c6f:::benchmark_data_smithi045_43640_object127195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.008113+0000", 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.6675290839999999, 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020023078, 2024-04-26T12:11:06.786 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127196 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008113+0000", 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008113+0000", 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008112+0000", 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008160+0000", 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7958999999999999e-05 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008168+0000", 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6090000000000003e-06 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008173+0000", 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8050000000000003e-06 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008214+0000", 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0969e-05 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008354+0000", 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013946 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008452+0000", 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8542000000000006e-05 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.017441+0000", 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089882320000000005 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.028080+0000", 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010639839 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.028111+0000", 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0642000000000002e-05 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.028136+0000", 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4556999999999999e-05 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.791 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127624 5.e 5:788210ca:::benchmark_data_smithi045_43640_object127623:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.4737246050000001, 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020581506999999999, 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127624 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.792 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:06.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201956+0000", 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9076000000000003e-05 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201964+0000", 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2369999999999992e-06 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201970+0000", 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3069999999999999e-06 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.203190+0000", 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012198070000000001 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.203323+0000", 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013341699999999999 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.203467+0000", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014364299999999999 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.205979+0000", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002512219 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.222431+0000", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016452168 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.222462+0000", 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0382000000000002e-05 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.222499+0000", 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6770999999999997e-05 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127844 5.e 5:7e3696ee:::benchmark_data_smithi045_43640_object127843:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.298154+0000", 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.3774879480000002, 2024-04-26T12:11:06.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020044451000000001, 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127844 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298154+0000", 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298154+0000", 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298153+0000", 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298211+0000", 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8244e-05 2024-04-26T12:11:06.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298222+0000", 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1267000000000001e-05 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298230+0000", 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5789999999999998e-06 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298287+0000", 2024-04-26T12:11:06.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298424+0000", 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013708200000000001 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298612+0000", 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018800199999999999 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.304381+0000", 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0057683109999999999 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318109+0000", 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013728027 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318159+0000", 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0556999999999997e-05 2024-04-26T12:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318198+0000", 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9082000000000003e-05 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127845 5.e 5:76b6adb1:::benchmark_data_smithi045_43640_object127844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.3773935640000001, 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020081132000000002, 2024-04-26T12:11:06.803 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127845 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:06.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298319+0000", 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1909000000000006e-05 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298327+0000", 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8439999999999998e-06 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298334+0000", 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7789999999999998e-06 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.300512+0000", 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021783359999999999 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.300635+0000", 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012221700000000001 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.300772+0000", 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.304390+0000", 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036183320000000001 2024-04-26T12:11:06.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318252+0000", 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013862429000000001 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318296+0000", 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3238000000000002e-05 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318329+0000", 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3652000000000002e-05 2024-04-26T12:11:06.808 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.809 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.809 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.809 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:06.809 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:06.809 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:06.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:06.811 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:06.809+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:06.913 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:06.910+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:06.998 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:06.998 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:06.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135981 5.a 5:5ab69deb:::benchmark_data_smithi045_43640_object135980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.990848+0000", 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0050707139999999996, 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051100529999999998, 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135981 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:06.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990848+0000", 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990848+0000", 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990848+0000", 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990959+0000", 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110917 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990965+0000", 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6810000000000003e-06 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990968+0000", 2024-04-26T12:11:07.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.709e-06 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.993256+0000", 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022872029999999998 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.993333+0000", 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7860000000000003e-05 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:07.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.993436+0000", 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000102573 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:135982 5.b e38/17 5:d43e3e75:::benchmark_data_smithi045_43640_object135981:head v 38'8444, mlcod=38'8442)", 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.991401+0000", 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0045180089999999999, 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046411830000000001, 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.003 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991401+0000", 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991401+0000", 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991401+0000", 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991458+0000", 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7062999999999999e-05 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991467+0000", 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3500000000000003e-06 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991473+0000", 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1759999999999998e-06 2024-04-26T12:11:07.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991511+0000", 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7670999999999999e-05 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991529+0000", 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8363999999999999e-05 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135984 5.c 5:326de788:::benchmark_data_smithi045_43640_object135983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.991667+0000", 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0042520759999999996, 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0044493550000000003, 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.007 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135984 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991667+0000", 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991667+0000", 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991666+0000", 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991771+0000", 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010492099999999999 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991782+0000", 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1174e-05 2024-04-26T12:11:07.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991791+0000", 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3459999999999994e-06 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991842+0000", 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1505000000000002e-05 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.992002+0000", 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000159285 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:135983 5.0 e38/17 5:02c52059:::benchmark_data_smithi045_43640_object135982:head v 38'8551, mlcod=38'8549)", 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.991992+0000", 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039272489999999998, 2024-04-26T12:11:07.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041902659999999998, 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991992+0000", 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991992+0000", 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991991+0000", 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.992933+0000", 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00094137400000000003 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.992940+0000", 2024-04-26T12:11:07.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.481e-06 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.992945+0000", 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0599999999999998e-06 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.992976+0000", 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1047999999999998e-05 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.992996+0000", 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9483e-05 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135985 5.7 5:e2d08e60:::benchmark_data_smithi045_43640_object135984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.994113+0000", 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0018062519999999999, 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021349820000000001, 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135985 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994113+0000", 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994113+0000", 2024-04-26T12:11:07.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994112+0000", 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994145+0000", 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3640999999999999e-05 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994157+0000", 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1878999999999999e-05 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994166+0000", 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5129999999999996e-06 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994200+0000", 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4759999999999999e-05 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994281+0000", 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0047000000000001e-05 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135988 5.6 5:69db041b:::benchmark_data_smithi045_43640_object135987:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.019 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.994522+0000", 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001397695, 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018009949999999999, 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135988 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994522+0000", 2024-04-26T12:11:07.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994522+0000", 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994521+0000", 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994610+0000", 2024-04-26T12:11:07.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8881999999999994e-05 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994621+0000", 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0995000000000001e-05 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994628+0000", 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5950000000000001e-06 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994669+0000", 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0797000000000003e-05 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994807+0000", 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013839700000000001 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135990 5.6 5.d9c0a1b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.023 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.994642+0000", 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0012772829999999999, 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001746708, 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135990 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994642+0000", 2024-04-26T12:11:07.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994642+0000", 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994641+0000", 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994730+0000", 2024-04-26T12:11:07.025 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994739+0000", 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2809999999999997e-06 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994754+0000", 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4552999999999999e-05 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135991 5.6 5.357289c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.994764+0000", 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001155075, 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001680111, 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135991 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.027 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994764+0000", 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994764+0000", 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994764+0000", 2024-04-26T12:11:07.028 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994794+0000", 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0762000000000001e-05 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994802+0000", 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9850000000000006e-06 2024-04-26T12:11:07.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.994809+0000", 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5710000000000003e-06 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:135986 5.4 e38/17 5:2ea4b817:::benchmark_data_smithi045_43640_object135985:head v 38'8594, mlcod=38'8592)", 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.995116+0000", 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00080273699999999998, 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013838959999999999, 2024-04-26T12:11:07.030 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995116+0000", 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995116+0000", 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.031 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995116+0000", 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995152+0000", 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6063999999999999e-05 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995160+0000", 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6039999999999993e-06 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995167+0000", 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1190000000000002e-06 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995208+0000", 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1377e-05 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995229+0000", 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0919000000000001e-05 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.033 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:135987 5.b e38/17 5:decac4e3:::benchmark_data_smithi045_43640_object135986:head v 38'8445, mlcod=38'8442)", 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.995177+0000", 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000742232, 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013802389999999999, 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.034 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995177+0000", 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995177+0000", 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995177+0000", 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.035 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995210+0000", 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3105000000000002e-05 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995216+0000", 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5740000000000001e-06 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995221+0000", 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.549e-06 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.036 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995256+0000", 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4588999999999997e-05 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995274+0000", 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8595000000000001e-05 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:135989 5.e e38/17)", 2024-04-26T12:11:07.037 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.995230+0000", 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00068965400000000005, 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001382742, 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995230+0000", 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995230+0000", 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.038 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995229+0000", 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995257+0000", 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7356e-05 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995264+0000", 2024-04-26T12:11:07.039 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3309999999999998e-06 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995268+0000", 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4510000000000002e-06 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135992 5.7 5:e372568f:::benchmark_data_smithi045_43640_object135991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.995785+0000", 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00013427, 2024-04-26T12:11:07.040 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00087832299999999997, 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135992 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995785+0000", 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.041 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995785+0000", 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995784+0000", 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995863+0000", 2024-04-26T12:11:07.042 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8832999999999996e-05 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995873+0000", 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7669999999999998e-06 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.995879+0000", 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.043 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.996093+0000", 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021422100000000001 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.996240+0000", 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014634500000000001 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135972 5.2 5:4ac0c79f:::benchmark_data_smithi045_43640_object135971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.988178+0000", 2024-04-26T12:11:07.044 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.007740856, 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085580259999999998, 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135972 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988178+0000", 2024-04-26T12:11:07.045 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988178+0000", 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988178+0000", 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988208+0000", 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0623999999999997e-05 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988216+0000", 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5050000000000001e-06 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988222+0000", 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.047 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988262+0000", 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9805999999999998e-05 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.988384+0000", 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012243200000000001 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135976 5.5 5:aec1f14f:::benchmark_data_smithi045_43640_object135975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.990373+0000", 2024-04-26T12:11:07.048 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0055466910000000003, 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0064424829999999997, 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135976 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990373+0000", 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.049 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990373+0000", 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990371+0000", 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990403+0000", 2024-04-26T12:11:07.050 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990413+0000", 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0414999999999999e-05 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990421+0000", 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4760000000000001e-06 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.051 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991125+0000", 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000704173 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991239+0000", 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113937 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.052 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135977 5.2 5:464142fe:::benchmark_data_smithi045_43640_object135976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.990629+0000", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0052904049999999998, 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062541660000000002, 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135977 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990629+0000", 2024-04-26T12:11:07.053 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990629+0000", 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990628+0000", 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.054 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990679+0000", 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0844000000000003e-05 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990687+0000", 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7020000000000001e-06 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990691+0000", 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:11:07.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991076+0000", 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00038478600000000003 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.991210+0000", 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013373200000000001 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:135978 5.2 5:4b6a7554:::benchmark_data_smithi045_43640_object135977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:06.990696+0000", 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0052231730000000002, 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062619199999999998, 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 135978 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990696+0000", 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990696+0000", 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990696+0000", 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990793+0000", 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7617999999999999e-05 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990799+0000", 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0430000000000004e-06 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.990803+0000", 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6689999999999999e-06 2024-04-26T12:11:07.059 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.993199+0000", 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023958500000000001 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:06.993325+0000", 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000126594 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.060 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:07.061 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 16 2024-04-26T12:11:07.061 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:07.062 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:07.063 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:07.062+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:07.078 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:11:07.163 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:07.161+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:07.251 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:07.251 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:07.251 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:07.251 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:07.251 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:07.263 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:07.262+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:07.266 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:07.364 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:07.363+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:07.461 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:07.461 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:07.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:07.461 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:07.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.461 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 32.206782003999997, 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:77673 5.a 5:58d24102:::benchmark_data_smithi045_43640_object77672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.652482283000001, 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020103069000000001, 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.467 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 77673 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805275+0000", 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805274+0000", 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805350+0000", 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5304999999999998e-05 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805355+0000", 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8679999999999998e-06 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.805359+0000", 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0130000000000004e-06 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.814925+0000", 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.009566392 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815098+0000", 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000172938 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.815291+0000", 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019348499999999999 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.821194+0000", 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059030250000000001 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825295+0000", 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041007090000000001 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825341+0000", 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5958000000000003e-05 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.825378+0000", 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6763e-05 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.480978735000001, 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.473 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:07.475 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:07.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:07.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.989789704, 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.479 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.481 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.485 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.987438328, 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:07.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:07.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.985795457000002, 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.491 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93983 5.1 5:8bada12f:::benchmark_data_smithi045_43640_object93982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 19.251420817, 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020168520999999998, 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.494 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93983 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206336+0000", 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206399+0000", 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3380000000000006e-05 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206413+0000", 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.417e-05 2024-04-26T12:11:07.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206419+0000", 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.93e-06 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209082+0000", 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026633809999999998 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.209210+0000", 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012757999999999999 2024-04-26T12:11:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226386+0000", 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017176417999999999 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226431+0000", 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4848999999999997e-05 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226505+0000", 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3440000000000002e-05 2024-04-26T12:11:07.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:93987 5.1 5:83d98f83:::benchmark_data_smithi045_43640_object93986:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 19.251081550999999, 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019944915000000001, 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.499 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 93987 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206675+0000", 2024-04-26T12:11:07.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206766+0000", 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1032000000000005e-05 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206777+0000", 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.206784+0000", 2024-04-26T12:11:07.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9820000000000002e-06 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212272+0000", 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054875999999999996 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.212367+0000", 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4911e-05 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226515+0000", 2024-04-26T12:11:07.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014147991 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226555+0000", 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0132000000000001e-05 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:48.226620+0000", 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5475999999999994e-05 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.974340045000002, 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.507 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.971085068000001, 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:07.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:07.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.968587393, 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.512 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:07.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.967904092000001, 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.965783576, 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.521 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:07.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:07.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:07.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.963569565, 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.525 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:07.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:07.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:07.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106795 5.2 5:482e82a5:::benchmark_data_smithi045_43640_object106794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.598000753999999, 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020094091000000001, 2024-04-26T12:11:07.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106795 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859756+0000", 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859794+0000", 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859802+0000", 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.859807+0000", 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7930000000000003e-06 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866586+0000", 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067787450000000001 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.866675+0000", 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9238000000000002e-05 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879723+0000", 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013047718 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879775+0000", 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2061999999999997e-05 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.879850+0000", 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5160000000000005e-05 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:106910 5.3 5:cfa93f72:::benchmark_data_smithi045_43640_object106909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.54777528, 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019992009000000002, 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.534 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 106910 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909982+0000", 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.909981+0000", 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910090+0000", 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010890700000000001 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910108+0000", 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7601e-05 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.910115+0000", 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1779999999999997e-06 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919202+0000", 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0090872590000000003 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.919346+0000", 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143759 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929852+0000", 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010506305000000001 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929899+0000", 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:53.929974+0000", 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4548000000000005e-05 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.538 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.444160736000001, 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:11:07.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.543 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.283070009999999, 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:07.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:07.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:07.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.547 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:116404 5.3 5:cf638628:::benchmark_data_smithi045_43640_object116403:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.3078290129999992, 2024-04-26T12:11:07.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020373558999999999, 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 116404 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149928+0000", 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149927+0000", 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.149989+0000", 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2156999999999995e-05 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150000+0000", 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0348e-05 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.150007+0000", 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1709999999999996e-06 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152529+0000", 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025221470000000002 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.152672+0000", 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014300200000000001 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170157+0000", 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017484911999999998 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170221+0000", 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4614000000000002e-05 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.552 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:58.170302+0000", 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0153000000000003e-05 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.192178189, 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:07.553 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:07.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:07.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:07.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.557 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.558 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.558 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:07.558 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:07.558 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:07.559 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:07.558+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:07.560 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:07.608 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 55 16 137341 137325 156.035 137.375 0.00551242 0.00640566 2024-04-26T12:11:07.660 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:07.659+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:07.737 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137611 5.d 5:b471a3f6:::benchmark_data_smithi045_43640_object137610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.732853+0000", 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003152874, 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031818340000000001, 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137611 2024-04-26T12:11:07.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732853+0000", 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732853+0000", 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732852+0000", 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732900+0000", 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7942000000000003e-05 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732911+0000", 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1287999999999999e-05 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732917+0000", 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0789999999999997e-06 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.732958+0000", 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.733094+0000", 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013681699999999999 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.741 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137613 5.b 5:d47b1192:::benchmark_data_smithi045_43640_object137612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734155+0000", 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001850825, 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001958034, 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137613 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.742 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734155+0000", 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734155+0000", 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734154+0000", 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734268+0000", 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011413699999999999 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734277+0000", 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4659999999999999e-06 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734282+0000", 2024-04-26T12:11:07.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.716e-06 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734325+0000", 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2218000000000001e-05 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734445+0000", 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000120561 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734574+0000", 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012871700000000001 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137614 5.b 5.d8ffdd2b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734290+0000", 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0017158539999999999, 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018931639999999999, 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:07.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137614 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734290+0000", 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734290+0000", 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734289+0000", 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734359+0000", 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9414999999999999e-05 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734365+0000", 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6999999999999996e-06 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734368+0000", 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8010000000000001e-06 2024-04-26T12:11:07.749 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137616 5.0 5:07afe87a:::benchmark_data_smithi045_43640_object137615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734387+0000", 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001618504, 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018533060000000001, 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.750 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137616 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734387+0000", 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734387+0000", 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734387+0000", 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734434+0000", 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7258000000000001e-05 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734439+0000", 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5700000000000003e-06 2024-04-26T12:11:07.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734442+0000", 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5700000000000001e-06 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734485+0000", 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2889999999999998e-05 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734614+0000", 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012941800000000001 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734799+0000", 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000185095 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137617 5.d 5:bd9be931:::benchmark_data_smithi045_43640_object137616:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734448+0000", 2024-04-26T12:11:07.754 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001557866, 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018675600000000001, 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137617 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734448+0000", 2024-04-26T12:11:07.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734448+0000", 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734447+0000", 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734506+0000", 2024-04-26T12:11:07.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8406000000000003e-05 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734510+0000", 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3030000000000001e-06 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734514+0000", 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.687e-06 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735224+0000", 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00070989100000000004 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735356+0000", 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013274399999999999 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137618 5.f 5:fc3b7a87:::benchmark_data_smithi045_43640_object137617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.758 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734518+0000", 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0014875089999999999, 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001863485, 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137618 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734518+0000", 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734518+0000", 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734518+0000", 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734645+0000", 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012692899999999999 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734656+0000", 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1095e-05 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734669+0000", 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2724e-05 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734710+0000", 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1439000000000001e-05 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734845+0000", 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013546899999999999 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.762 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137619 5.8 5:1350bdbe:::benchmark_data_smithi045_43640_object137618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734681+0000", 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0013242589999999999, 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017665510000000001, 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137619 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734681+0000", 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734681+0000", 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734681+0000", 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734720+0000", 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9530999999999998e-05 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734729+0000", 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734736+0000", 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.888e-06 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734799+0000", 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2862999999999998e-05 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734938+0000", 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000138357 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735099+0000", 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000161118 2024-04-26T12:11:07.766 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137620 5.d 5.a0c690bd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734747+0000", 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0012588639999999999, 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001770995, 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137620 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734747+0000", 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734747+0000", 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734746+0000", 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734859+0000", 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112904 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734869+0000", 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:11:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734876+0000", 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2459999999999997e-06 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:137623 5.b 5.a9238d4b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.734892+0000", 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0011138669999999999, 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001677886, 2024-04-26T12:11:07.770 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 137623 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734892+0000", 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734892+0000", 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734891+0000", 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734974+0000", 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2416000000000005e-05 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734981+0000", 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8019999999999992e-06 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.734988+0000", 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.773 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:137624 5.a e39/17 5:5ee8a66f:::benchmark_data_smithi045_43640_object137623:head v 39'8549, mlcod=39'8547)", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:07.735381+0000", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00062466900000000001, 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001242539, 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735381+0000", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735381+0000", 2024-04-26T12:11:07.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735380+0000", 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735409+0000", 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8229e-05 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735418+0000", 2024-04-26T12:11:07.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2650000000000002e-06 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735424+0000", 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7760000000000003e-06 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735865+0000", 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00044169700000000001 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:07.735885+0000", 2024-04-26T12:11:07.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9463999999999999e-05 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 10 2024-04-26T12:11:07.777 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:07.778 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:07.779 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:07.777+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:07.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:07.879 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:07.878+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:07.980 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:07.979+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:07.997 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:08.001 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:08.001 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:08.016 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:08.020 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:08.024 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:08.024 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:08.081 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:08.080+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:08.182 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:08.181+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:08.190 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:08.190 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:08.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:08.283 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:08.282+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:08.384 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:08.383+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:08.396 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:08.396 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:08.410 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:08.494 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:08.493+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:08.586 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:08.585+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:08.609 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 56 16 139547 139531 155.71 137.875 0.00339941 0.00641895 2024-04-26T12:11:08.636 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:08.636 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:08.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:08.687 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:08.686+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:08.788 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:08.787+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:08.881 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:08.882 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:08.890 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:08.889+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:08.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:08.991 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:08.990+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:09.074 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:09.074 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:09.088 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:09.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:11:09.133 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.132+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:09.192 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:09.191+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:09.273 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:09.273 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:09.289 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:09.292 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:09.291+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:09.393 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.392+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:09.495 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:09.494+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:09.502 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:09.502 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:09.518 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:09.596 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.595+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:09.609 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 57 16 141800 141784 155.448 140.812 0.00278463 0.00642968 2024-04-26T12:11:09.697 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.696+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:09.719 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:09.719 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:09.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:09.798 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.797+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:09.799 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:11:09.899 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.898+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:09.909 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-26T12:11:09.915 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:09.915 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:09.930 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:10.000 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:09.999+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:10.010 INFO:teuthology.orchestra.console.smithi071:Power on completed 2024-04-26T12:11:10.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:10.101 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:10.100+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:10.112 DEBUG:teuthology.orchestra.console.smithi071:Waiting for login prompt 2024-04-26T12:11:10.112 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi071 2024-04-26T12:11:10.120 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:10.121 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:10.135 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:11:10.136 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:10.202 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:10.201+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:10.210 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:10.232 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:10.232 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:10.232 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:10.232 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:10.234 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:10.235 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:10.306 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:10.305+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143264 5.4 5:240c0686:::benchmark_data_smithi045_43640_object143263:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.306623+0000", 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0080927829999999992, 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0081237719999999996, 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.317 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143264 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306623+0000", 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306623+0000", 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306622+0000", 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306656+0000", 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4186000000000001e-05 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306664+0000", 2024-04-26T12:11:10.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8310000000000001e-06 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306670+0000", 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2280000000000003e-06 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310866+0000", 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0041961079999999996 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310981+0000", 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011414800000000001 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.311113+0000", 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013233099999999999 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:143265 5.a e40/17 5:5be263ef:::benchmark_data_smithi045_43640_object143264:head v 40'8894, mlcod=40'8892)", 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.309006+0000", 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0057092439999999996, 2024-04-26T12:11:10.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.005827835, 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309006+0000", 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309006+0000", 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309005+0000", 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309076+0000", 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0444000000000005e-05 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309086+0000", 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0271e-05 2024-04-26T12:11:10.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309094+0000", 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4919999999999996e-06 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309157+0000", 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3637000000000001e-05 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309173+0000", 2024-04-26T12:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.6062e-05 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:143271 5.a e40/17 5:53fd71cd:::benchmark_data_smithi045_43640_object143270:head v 40'8895, mlcod=40'8892)", 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.309435+0000", 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0052806839999999999, 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0054618009999999996, 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309435+0000", 2024-04-26T12:11:10.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309435+0000", 2024-04-26T12:11:10.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309434+0000", 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309498+0000", 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309507+0000", 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:11:10.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.309512+0000", 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9620000000000001e-06 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310848+0000", 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001336039 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310879+0000", 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:11:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143273 5.0 5:0ba39348:::benchmark_data_smithi045_43640_object143272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.310025+0000", 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.004690774, 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0049381039999999996, 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143273 2024-04-26T12:11:10.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310025+0000", 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310025+0000", 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310024+0000", 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310084+0000", 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0268e-05 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310092+0000", 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2679999999999994e-06 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310097+0000", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0810000000000001e-06 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310138+0000", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1001000000000003e-05 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310275+0000", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013640500000000001 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310417+0000", 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014227599999999999 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313024+0000", 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026063710000000001 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143274 5.b 5:d109006c:::benchmark_data_smithi045_43640_object143273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.310112+0000", 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0046030869999999996, 2024-04-26T12:11:10.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.004931324, 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143274 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310112+0000", 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310112+0000", 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310112+0000", 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310171+0000", 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9079999999999997e-05 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310177+0000", 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7049999999999996e-06 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310181+0000", 2024-04-26T12:11:10.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.019e-06 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310212+0000", 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1338999999999999e-05 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310415+0000", 2024-04-26T12:11:10.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00020285400000000001 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310554+0000", 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000138706 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143276 5.d 5:bdbc148c:::benchmark_data_smithi045_43640_object143275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.310239+0000", 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0044770000000000001, 2024-04-26T12:11:10.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048810499999999996, 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143276 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310239+0000", 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310239+0000", 2024-04-26T12:11:10.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310238+0000", 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310360+0000", 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121929 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310368+0000", 2024-04-26T12:11:10.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3049999999999993e-06 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310376+0000", 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3890000000000005e-06 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310589+0000", 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00021247 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310720+0000", 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000131505 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143277 5.d 5:b90d245e:::benchmark_data_smithi045_43640_object143276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.310390+0000", 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0043253800000000002, 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0047961159999999996, 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143277 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310390+0000", 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310390+0000", 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310390+0000", 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310449+0000", 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9450999999999997e-05 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310457+0000", 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4489999999999999e-06 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310464+0000", 2024-04-26T12:11:10.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5089999999999999e-06 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312902+0000", 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024384670000000002 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313036+0000", 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013401799999999999 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.349 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:143275 5.a e40/17 5:5833317d:::benchmark_data_smithi045_43640_object143274:head v 40'8896, mlcod=40'8892)", 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.312905+0000", 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0018104390000000001, 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023457370000000001, 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312905+0000", 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312905+0000", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312904+0000", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312941+0000", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6831e-05 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312948+0000", 2024-04-26T12:11:10.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1169999999999998e-06 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312953+0000", 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5510000000000001e-06 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.312994+0000", 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0849000000000001e-05 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313013+0000", 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9525999999999999e-05 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143280 5.b 5:ddb2de21:::benchmark_data_smithi045_43640_object143279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.313194+0000", 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001521861, 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002117262, 2024-04-26T12:11:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143280 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313194+0000", 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313194+0000", 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313193+0000", 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313223+0000", 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0499000000000001e-05 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313234+0000", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1061e-05 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313241+0000", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0829999999999998e-06 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313277+0000", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5414999999999999e-05 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313379+0000", 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102703 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313523+0000", 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014321200000000001 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143281 5.8 5:155cd1fb:::benchmark_data_smithi045_43640_object143280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.313254+0000", 2024-04-26T12:11:10.357 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0014611959999999999, 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002129012, 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143281 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313254+0000", 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313254+0000", 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313254+0000", 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313278+0000", 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4341e-05 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313285+0000", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313291+0000", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313321+0000", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0565000000000003e-05 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313428+0000", 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106443 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313557+0000", 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012963100000000001 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143282 5.f 5:f665911a:::benchmark_data_smithi045_43640_object143281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.313501+0000", 2024-04-26T12:11:10.361 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0012144809999999999, 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019549300000000001, 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143282 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313501+0000", 2024-04-26T12:11:10.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313501+0000", 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313500+0000", 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313554+0000", 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4092000000000003e-05 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313563+0000", 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7250000000000003e-06 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313578+0000", 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5038000000000001e-05 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313786+0000", 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000208016 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313947+0000", 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016113600000000001 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143283 5.9 5:9f7965d1:::benchmark_data_smithi045_43640_object143282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.313590+0000", 2024-04-26T12:11:10.365 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001125563, 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019319160000000001, 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143283 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313590+0000", 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313590+0000", 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313590+0000", 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313618+0000", 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8632999999999998e-05 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313625+0000", 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.126e-06 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313631+0000", 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2159999999999997e-06 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313671+0000", 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0179999999999998e-05 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.313787+0000", 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116087 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:143262 5.e 5:77aa763e:::benchmark_data_smithi045_43640_object143261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:10.306463+0000", 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0082525919999999996, 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0091280340000000001, 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:10.369 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 143262 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306463+0000", 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306463+0000", 2024-04-26T12:11:10.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306462+0000", 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306591+0000", 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012888400000000001 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306600+0000", 2024-04-26T12:11:10.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0950000000000002e-06 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306613+0000", 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2713e-05 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306734+0000", 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121629 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.306870+0000", 2024-04-26T12:11:10.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013576300000000001 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.307099+0000", 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000228741 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:10.310358+0000", 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0032592670000000002 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.373 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.374 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:10.374 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 13 2024-04-26T12:11:10.374 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:10.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:10.405 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:10.404+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:10.507 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:10.506+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:10.587 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:10.588 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:10.588 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:10.588 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:10.588 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:10.602 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:10.607 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:10.606+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:10.609 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 58 16 143981 143965 155.118 136.312 0.00810665 0.00644337 2024-04-26T12:11:10.708 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:10.707+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:10.788 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:59102 5.e 5:79bed4d4:::benchmark_data_smithi045_43640_object59101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.257484214999998, 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020154308999999999, 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 59102 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527289+0000", 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527288+0000", 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527430+0000", 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014243700000000001 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527437+0000", 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.527441+0000", 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0489999999999997e-06 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529884+0000", 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024431190000000001 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.529976+0000", 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2152999999999997e-05 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.530065+0000", 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8375999999999995e-05 2024-04-26T12:11:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.531300+0000", 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001235625 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547312+0000", 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016011465999999999 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547371+0000", 2024-04-26T12:11:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8990999999999998e-05 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:31.547443+0000", 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1957000000000002e-05 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.316425932000001, 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:10.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:10.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.314810689000002, 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.800 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.805 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.312446393999998, 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.806 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.811 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.398395081, 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:10.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:10.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96735 5.b 5:de09d9e8:::benchmark_data_smithi045_43640_object96734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.393685920999999, 2024-04-26T12:11:10.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020069007, 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96735 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391087+0000", 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391086+0000", 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391144+0000", 2024-04-26T12:11:10.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8223000000000001e-05 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391155+0000", 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0530000000000001e-05 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391170+0000", 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4722999999999999e-05 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391287+0000", 2024-04-26T12:11:10.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117304 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391381+0000", 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3951999999999998e-05 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.391470+0000", 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9425999999999994e-05 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392922+0000", 2024-04-26T12:11:10.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001451665 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411075+0000", 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018153385000000001 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411120+0000", 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4799999999999998e-05 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411156+0000", 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5728000000000001e-05 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.303715500999999, 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.823 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:10.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.826 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.828 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.298507730000001, 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.829 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:10.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:10.834 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.295308771999998, 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.835 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:10.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:10.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.295056964, 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.841 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:10.843 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:10.844 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.845 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:10.846 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.292400925999999, 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:10.848 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.849 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.850 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.851 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.290894157, 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.852 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.288283704000001, 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.858 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:10.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:10.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.863 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.441681044999999, 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:10.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.867 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:116265 5.b 5:d0dab8b8:::benchmark_data_smithi045_43640_object116264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.705287259, 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020066792, 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 116265 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.870 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079486+0000", 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079485+0000", 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079557+0000", 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2298999999999993e-05 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079565+0000", 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079571+0000", 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.872 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079782+0000", 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000211151 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079878+0000", 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6039999999999995e-05 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.079970+0000", 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.1728e-05 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.081597+0000", 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016275899999999999 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099457+0000", 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017860034 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099504+0000", 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6916000000000003e-05 2024-04-26T12:11:10.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:58.099552+0000", 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8068999999999997e-05 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.4902219199999998, 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:10.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:10.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:10.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:10.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127196 5.e 5:7fe59c6f:::benchmark_data_smithi045_43640_object127195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.008113+0000", 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.7766601780000002, 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020023078, 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127196 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008113+0000", 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008113+0000", 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008112+0000", 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008160+0000", 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7958999999999999e-05 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008168+0000", 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6090000000000003e-06 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008173+0000", 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8050000000000003e-06 2024-04-26T12:11:10.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008214+0000", 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0969e-05 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008354+0000", 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013946 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.008452+0000", 2024-04-26T12:11:10.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.8542000000000006e-05 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.017441+0000", 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089882320000000005 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.028080+0000", 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.010639839 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.028111+0000", 2024-04-26T12:11:10.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0642000000000002e-05 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.028136+0000", 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4556999999999999e-05 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127624 5.e 5:788210ca:::benchmark_data_smithi045_43640_object127623:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:10.886 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.5828556989999996, 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020581506999999999, 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127624 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201917+0000", 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201956+0000", 2024-04-26T12:11:10.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9076000000000003e-05 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201964+0000", 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2369999999999992e-06 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.201970+0000", 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3069999999999999e-06 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.203190+0000", 2024-04-26T12:11:10.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012198070000000001 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.203323+0000", 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013341699999999999 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.203467+0000", 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014364299999999999 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.205979+0000", 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002512219 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.222431+0000", 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016452168 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.222462+0000", 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0382000000000002e-05 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.222499+0000", 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6770999999999997e-05 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127844 5.e 5:7e3696ee:::benchmark_data_smithi045_43640_object127843:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.298154+0000", 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.4866190420000001, 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020044451000000001, 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.892 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127844 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298154+0000", 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298154+0000", 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298153+0000", 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298211+0000", 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8244e-05 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298222+0000", 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1267000000000001e-05 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298230+0000", 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5789999999999998e-06 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298287+0000", 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298424+0000", 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013708200000000001 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298612+0000", 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018800199999999999 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.304381+0000", 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0057683109999999999 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318109+0000", 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013728027 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318159+0000", 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0556999999999997e-05 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318198+0000", 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9082000000000003e-05 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.897 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:127845 5.e 5:76b6adb1:::benchmark_data_smithi045_43640_object127844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.4865246580000004, 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020081132000000002, 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 127845 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298248+0000", 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298319+0000", 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1909000000000006e-05 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298327+0000", 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8439999999999998e-06 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.298334+0000", 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7789999999999998e-06 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.300512+0000", 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021783359999999999 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.300635+0000", 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012221700000000001 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.300772+0000", 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000136921 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.304390+0000", 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0036183320000000001 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318252+0000", 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013862429000000001 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318296+0000", 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3238000000000002e-05 2024-04-26T12:11:10.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:03.318329+0000", 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3652000000000002e-05 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:10.903 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:10.905 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:10.906 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:10.903+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:11.005 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.004+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145039 5.3 5:c57d8694:::benchmark_data_smithi045_43640_object145038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.083467+0000", 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0088423570000000003, 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0088630629999999992, 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.094 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145039 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.083467+0000", 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.083467+0000", 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.083466+0000", 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.083518+0000", 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2012000000000003e-05 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.083527+0000", 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4190000000000002e-06 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.083534+0000", 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.956e-06 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088657+0000", 2024-04-26T12:11:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005123425 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088812+0000", 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000154704 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145043 5.2 5:4e25c9d4:::benchmark_data_smithi045_43640_object145042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.086097+0000", 2024-04-26T12:11:11.098 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0062121859999999997, 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062875980000000001, 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145043 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086097+0000", 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086097+0000", 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086097+0000", 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086133+0000", 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5948000000000002e-05 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086140+0000", 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.374e-06 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086146+0000", 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3579999999999999e-06 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.101 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086194+0000", 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8099999999999997e-05 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086357+0000", 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000162857 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.102 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145044 5.a 5:5d3941e4:::benchmark_data_smithi045_43640_object145043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.086156+0000", 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0061533589999999997, 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0062723220000000003, 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145044 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.103 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086156+0000", 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086156+0000", 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086155+0000", 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.104 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086194+0000", 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8510000000000002e-05 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086202+0000", 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7579999999999992e-06 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086208+0000", 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.976e-06 2024-04-26T12:11:11.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086243+0000", 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5374999999999999e-05 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086332+0000", 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8945999999999998e-05 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086440+0000", 2024-04-26T12:11:11.106 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000107598 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088904+0000", 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024643109999999998 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:145047 5.b e40/17 5:dd0aa00e:::benchmark_data_smithi045_43640_object145046:head v 40'8978, mlcod=40'8975)", 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.086693+0000", 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0056162620000000003, 2024-04-26T12:11:11.107 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057806690000000004, 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086693+0000", 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086693+0000", 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086692+0000", 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086761+0000", 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8324000000000005e-05 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086769+0000", 2024-04-26T12:11:11.109 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4500000000000004e-06 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.086777+0000", 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6410000000000002e-06 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089764+0000", 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002987394 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.110 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089779+0000", 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4399999999999999e-05 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145050 5.2 5:432a4d22:::benchmark_data_smithi045_43640_object145049:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.088235+0000", 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004074383, 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042756879999999997, 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:11.111 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145050 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088235+0000", 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088235+0000", 2024-04-26T12:11:11.112 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088234+0000", 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088322+0000", 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7453000000000004e-05 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088330+0000", 2024-04-26T12:11:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5900000000000002e-06 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088335+0000", 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8259999999999998e-06 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088610+0000", 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00027472199999999998 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.114 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.088739+0000", 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012863300000000001 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145051 5.a 5:578d818c:::benchmark_data_smithi045_43640_object145050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.089036+0000", 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003273045, 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035136289999999999, 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.115 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145051 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089036+0000", 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089036+0000", 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.116 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089036+0000", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089122+0000", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6658999999999998e-05 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089131+0000", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089136+0000", 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8239999999999999e-06 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089173+0000", 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7373000000000003e-05 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089296+0000", 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012222000000000001 2024-04-26T12:11:11.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.089434+0000", 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013807399999999999 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145053 5.a 5:59947da7:::benchmark_data_smithi045_43640_object145052:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.091050+0000", 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001259668, 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001542311, 2024-04-26T12:11:11.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145053 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091050+0000", 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.120 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091050+0000", 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091049+0000", 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091291+0000", 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00024279 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091302+0000", 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0849000000000001e-05 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091311+0000", 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4209999999999995e-06 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091363+0000", 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1907999999999998e-05 2024-04-26T12:11:11.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091506+0000", 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014365600000000001 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091667+0000", 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016046300000000001 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:145054 5.5 5:ad436ff7:::benchmark_data_smithi045_43640_object145053:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.091322+0000", 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000987136, 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001314218, 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 145054 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.124 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091322+0000", 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091322+0000", 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091321+0000", 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.125 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091351+0000", 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.942e-05 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091357+0000", 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6910000000000002e-06 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091361+0000", 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1080000000000003e-06 2024-04-26T12:11:11.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091394+0000", 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3028999999999998e-05 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091521+0000", 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012683200000000001 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.127 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:145051 5.a e40/17)", 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.091373+0000", 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00093661299999999999, 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001298984, 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091373+0000", 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.128 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091373+0000", 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091372+0000", 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091377+0000", 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.129 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091386+0000", 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7059999999999993e-06 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091393+0000", 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:145055 5.e e40/17 5:786aacee:::benchmark_data_smithi045_43640_object145054:head v 40'9096, mlcod=40'9094)", 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.091638+0000", 2024-04-26T12:11:11.130 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00067145499999999995, 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001061427, 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091638+0000", 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091638+0000", 2024-04-26T12:11:11.131 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091637+0000", 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091698+0000", 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0436000000000002e-05 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.132 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091707+0000", 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8529999999999998e-06 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091713+0000", 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6250000000000001e-06 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091756+0000", 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2894e-05 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.133 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.091774+0000", 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7441000000000001e-05 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 10 2024-04-26T12:11:11.134 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:11.135 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.134+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.136 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:11.236 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.235+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.324 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:11.324 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:11.324 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:11.325 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:11.325 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:11.338 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:11.337+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:11.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:11.438 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.437+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.538 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.537+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.574 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 36.320210787999997, 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.594407519000001, 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.103218488, 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.100867112, 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.099224241000002, 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.087768829000002, 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.084513852000001, 2024-04-26T12:11:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.082016177, 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.081332876000001, 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.07921236, 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.076998349, 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.557589520000001, 2024-04-26T12:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:11:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:11:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 14.396498793999999, 2024-04-26T12:11:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.640 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.641 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:11.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:11.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.3056069729999997, 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.644 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:11.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.648 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144974 5.c 5:3ab50d54:::benchmark_data_smithi045_43640_object144973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.52461113299999995, 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020753246999999999, 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144974 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:11.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046574+0000", 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046674+0000", 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9868e-05 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046683+0000", 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046689+0000", 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2729999999999999e-06 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046767+0000", 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7288999999999998e-05 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046944+0000", 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017754700000000001 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067230+0000", 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020285184000000001 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067283+0000", 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3986000000000001e-05 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.653 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067328+0000", 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4404999999999999e-05 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144975 5.c 5:3d48118b:::benchmark_data_smithi045_43640_object144974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.524484379, 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020691542, 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:11.654 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144975 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046764+0000", 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046771+0000", 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4390000000000003e-06 2024-04-26T12:11:11.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046778+0000", 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050750+0000", 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039718959999999999 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050862+0000", 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000111906 2024-04-26T12:11:11.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067333+0000", 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016471171999999999 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067356+0000", 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2840000000000002e-05 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067393+0000", 2024-04-26T12:11:11.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6885999999999999e-05 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.52285156300000002, 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.659 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.660 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.661 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.661 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:11.661 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:11.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:11.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144971 5.4 e40/17 5:25843963:::benchmark_data_smithi045_43640_object144970:head v 40'9138, mlcod=40'9135)", 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.52260606799999998, 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020798423, 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.665 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048579+0000", 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048647+0000", 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7360000000000006e-05 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048655+0000", 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8970000000000008e-06 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048661+0000", 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062933+0000", 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014272093 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062953+0000", 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0778e-05 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069352+0000", 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063989310000000001 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069378+0000", 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5831999999999999e-05 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.668 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.52107313700000002, 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:11.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.670 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.51854894299999998, 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:11.677 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:11.678 INFO:tasks.radosbench.radosbench.0.smithi045.stdout: 59 16 146102 146086 154.736 132.562 0.00782049 0.00645915 2024-04-26T12:11:11.679 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.677+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:11.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-04-26T12:11:11.783 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:11.782+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146675 5.f 5:fb87c94d:::benchmark_data_smithi045_43640_object146674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.854204+0000", 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0035614520000000001, 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035830469999999998, 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.859 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146675 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854204+0000", 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854204+0000", 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.860 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854203+0000", 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854273+0000", 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9863999999999994e-05 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854283+0000", 2024-04-26T12:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.009e-05 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854291+0000", 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4919999999999996e-06 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854333+0000", 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2582e-05 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.862 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854478+0000", 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014453400000000001 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146676 5.9 5:91af36c1:::benchmark_data_smithi045_43640_object146675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.854303+0000", 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003462892, 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035501249999999999, 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.863 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146676 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854303+0000", 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854303+0000", 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.864 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854302+0000", 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854368+0000", 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5918000000000001e-05 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854376+0000", 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7959999999999996e-06 2024-04-26T12:11:11.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854383+0000", 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4800000000000004e-06 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854444+0000", 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1033000000000003e-05 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854574+0000", 2024-04-26T12:11:11.866 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129543 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146679 5.8 5:179d300d:::benchmark_data_smithi045_43640_object146678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.854395+0000", 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003370751, 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003525958, 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.867 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146679 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854395+0000", 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854395+0000", 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.868 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854394+0000", 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855159+0000", 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00076441699999999998 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855168+0000", 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.499e-06 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.869 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855175+0000", 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9689999999999997e-06 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855211+0000", 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6158999999999997e-05 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855337+0000", 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012578200000000001 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:11.870 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855475+0000", 2024-04-26T12:11:11.871 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013762600000000001 2024-04-26T12:11:11.871 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.871 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.871 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.871 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146681 5.0 5:0d49ee2e:::benchmark_data_smithi045_43640_object146680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.855185+0000", 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0025800879999999999, 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0027824249999999998, 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146681 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855185+0000", 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855185+0000", 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855185+0000", 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855213+0000", 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8625000000000001e-05 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855221+0000", 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2760000000000003e-06 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855226+0000", 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:11:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855259+0000", 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2974e-05 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855381+0000", 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012182 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855517+0000", 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013623500000000001 2024-04-26T12:11:11.875 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857903+0000", 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002385346 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146685 5.e 5:7564f80c:::benchmark_data_smithi045_43640_object146684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.855456+0000", 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0023092799999999999, 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0025608219999999999, 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.876 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146685 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855456+0000", 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.877 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855456+0000", 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855456+0000", 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855569+0000", 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113615 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.878 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855578+0000", 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7960000000000001e-06 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855585+0000", 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0500000000000003e-06 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855630+0000", 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4956000000000001e-05 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.879 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855757+0000", 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012723500000000001 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855909+0000", 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000151404 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:146686 5.a e40/17 5:592b4a62:::benchmark_data_smithi045_43640_object146685:head v 40'9098, mlcod=40'9096)", 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.857407+0000", 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.000358649, 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00065674199999999998, 2024-04-26T12:11:11.880 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857407+0000", 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857407+0000", 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.881 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857406+0000", 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857440+0000", 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4273999999999997e-05 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857456+0000", 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.5778e-05 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857462+0000", 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1330000000000004e-06 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857520+0000", 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7506000000000001e-05 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857541+0000", 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1359e-05 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.883 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146672 5.4 5:24579770:::benchmark_data_smithi045_43640_object146671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.851605+0000", 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0061610700000000003, 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0064956149999999997, 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146672 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.884 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851605+0000", 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851605+0000", 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851604+0000", 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.885 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851638+0000", 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4418999999999997e-05 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851645+0000", 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1949999999999997e-06 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851651+0000", 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.886 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851681+0000", 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9649999999999999e-05 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.851764+0000", 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3546000000000003e-05 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.852067+0000", 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00030254000000000001 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.887 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.855450+0000", 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003383568 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146673 5.4 5:26eb0f72:::benchmark_data_smithi045_43640_object146672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.853981+0000", 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0037849070000000001, 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.004178579, 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:11.888 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146673 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.853981+0000", 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.853981+0000", 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:11.889 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.853980+0000", 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854035+0000", 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5158000000000003e-05 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854044+0000", 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8400000000000001e-06 2024-04-26T12:11:11.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854049+0000", 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0250000000000002e-06 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854086+0000", 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6649000000000001e-05 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854208+0000", 2024-04-26T12:11:11.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012255299999999999 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.854349+0000", 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014075700000000001 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.857672+0000", 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033230790000000001 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:11.892 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 8 2024-04-26T12:11:11.893 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:11.894 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:11.894 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.893+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:11.994 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:11.993+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:12.096 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:12.095+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:12.107 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:12.107 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:12.107 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:12.107 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:12.107 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:12.121 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:12.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:11:12.196 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:12.195+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:12.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:12.297 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:12.296+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:12.340 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.869387557, 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:12.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:12.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.867772314, 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:12.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.865408019, 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:12.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.951356705999999, 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.358 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:12.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:12.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.856677126000001, 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.363 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:12.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.368 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.851469354999999, 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.848270397, 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.374 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:12.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:12.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:12.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.848018588999999, 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:12.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:12.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.845362551000001, 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.843855781999999, 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.391 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:12.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:12.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.841245328999999, 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.994642669999999, 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.402 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:12.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.407 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.043183545, 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:12.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:12.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:12.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:12.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:12.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.291459734, 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.413 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:12.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.418 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.291351117, 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:12.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.290942574, 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.424 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.429 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.2854874139999999, 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.430 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:12.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:12.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:12.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.1587678050000001, 2024-04-26T12:11:12.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.55272207600000001, 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:12.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:12.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.55256265800000004, 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:12.452 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:12.452 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:12.453 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:12.453 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:12.454 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:12.454 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:12.452+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:12.552 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:12.551+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:12.609 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Total time run: 60.0043 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Total writes made: 148371 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Write size: 65536 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Object size: 65536 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Bandwidth (MB/sec): 154.542 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Stddev Bandwidth: 43.0202 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Max bandwidth (MB/sec): 345.375 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Min bandwidth (MB/sec): 51.75 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Average IOPS: 2472 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Stddev IOPS: 688.323 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Max IOPS: 5526 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Min IOPS: 828 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Average Latency(s): 0.00646774 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Stddev Latency(s): 0.0109221 2024-04-26T12:11:12.610 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Max latency(s): 1.02576 2024-04-26T12:11:12.611 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Min latency(s): 0.00110881 2024-04-26T12:11:12.612 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Cleaning up (deleting benchmark objects) 2024-04-26T12:11:12.642 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:12.643 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:12.655 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:12.652+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:12.659 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:12.754 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:12.753+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:12.855 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:12.854+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:12.887 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:12.887 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:12.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:12.958 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:12.956+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:13.057 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.056+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.087 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:13.087 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:13.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:13.138 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:11:13.162 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:13.157+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:13.259 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.258+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.297 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:13.297 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:13.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:13.386 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:13.385+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:13.460 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.459+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.518 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:13.518 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:13.533 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:13.561 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.560+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.661 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:13.660+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:13.753 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:13.754 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:13.763 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.761+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:13.863 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.862+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.960 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:13.961 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:13.964 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:13.963+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:13.978 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:14.065 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:14.064+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:14.166 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:14.164+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:14.220 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:14.220 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:14.230 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:14.276 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:14.274+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:14.367 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:14.366+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:14.427 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:14.427 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:14.443 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:14.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:14.485 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:14.484+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:14.570 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:14.568+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:14.626 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:14.626 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:14.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:14.642 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:14.650 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:14.654 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:14.654 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:14.655 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:14.686 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:14.685+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:14.771 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:14.770+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:14.820 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:14.820 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:14.821 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:14.821 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:14.821 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:14.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:14.872 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:14.870+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:14.972 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:14.971+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:15.049 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:15.049 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:15.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:15.049 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:15.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.577414821000001, 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:15.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.575799578000002, 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:15.055 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.060 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.573435282999998, 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.061 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:15.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:15.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:15.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.069 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.65938397, 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:15.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.564704389999999, 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.075 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.080 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.559496619000001, 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.081 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:15.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:15.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:15.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.556297660999999, 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:15.088 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:15.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:15.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.556045853000001, 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.094 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:15.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:15.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:15.099 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.553389814999999, 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:15.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:15.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.551883046, 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.106 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:15.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:15.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:15.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.549272593000001, 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.113 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:15.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:15.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.702669933999999, 2024-04-26T12:11:15.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:15.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:15.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:15.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.126 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.751210809, 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:15.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:15.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:15.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:15.133 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.9994869980000001, 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:15.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:15.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:15.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.139 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.9993783810000001, 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:15.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:15.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.145 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.146 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.146 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:15.146 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.9989698379999998, 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.147 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:15.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:15.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.9935146779999999, 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:15.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:15.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:15.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.8667950690000001, 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:15.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:15.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.2607493399999998, 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:15.167 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 3.2605899219999999, 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:15.172 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.176 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.177 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:15.177 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:15.177 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:15.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:11:15.179 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:15.180 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:15.177+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:15.279 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:15.278+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:15.382 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:15.380+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:15.386 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155940 5.6 5:6e7c3217:::benchmark_data_smithi045_43640_object7566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.379629+0000", 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.005269419, 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052955490000000001, 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155940 2024-04-26T12:11:15.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379629+0000", 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379629+0000", 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379629+0000", 2024-04-26T12:11:15.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379633+0000", 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.605e-06 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379643+0000", 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379650+0000", 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0190000000000001e-06 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380386+0000", 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00073651100000000002 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380521+0000", 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013433 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155942 5.6 5:6e2f9ff5:::benchmark_data_smithi045_43640_object7568:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.379858+0000", 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0050404710000000004, 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051479819999999997, 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155942 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379858+0000", 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379858+0000", 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379858+0000", 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379862+0000", 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.827e-06 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379870+0000", 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.977e-06 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379875+0000", 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382210+0000", 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023347590000000001 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382340+0000", 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013012000000000001 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.395 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:155941 5.e e41/17 5:72f56f27:::benchmark_data_smithi045_43640_object7567:head v 41'9758, mlcod=41'9756)", 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.379940+0000", 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0049585460000000003, 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0051347169999999996, 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379940+0000", 2024-04-26T12:11:15.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379940+0000", 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379940+0000", 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379945+0000", 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5629999999999999e-06 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379955+0000", 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6350000000000001e-06 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.379962+0000", 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6640000000000001e-06 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380369+0000", 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00040698600000000002 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380386+0000", 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7416999999999999e-05 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155943 5.6 5:6d1b3508:::benchmark_data_smithi045_43640_object7569:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.380487+0000", 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0044114929999999998, 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046495219999999997, 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.400 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155943 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380487+0000", 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380487+0000", 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380487+0000", 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380491+0000", 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380500+0000", 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2869999999999993e-06 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.380507+0000", 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8419999999999999e-06 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.383881+0000", 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033738539999999999 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384011+0000", 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013038000000000001 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155944 5.c 5:30cf235e:::benchmark_data_smithi045_43640_object7570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.381030+0000", 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003868626, 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041764740000000003, 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.405 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155944 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381030+0000", 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381030+0000", 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381030+0000", 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381034+0000", 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3630000000000004e-06 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381041+0000", 2024-04-26T12:11:15.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381047+0000", 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.203e-06 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381083+0000", 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6786000000000003e-05 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.381193+0000", 2024-04-26T12:11:15.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010948200000000001 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:155937 5.8 e41/17 5:16529568:::benchmark_data_smithi045_43640_object7563:head v 41'9552, mlcod=41'9548)", 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.382452+0000", 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0024464199999999999, 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028237280000000002, 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382452+0000", 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382452+0000", 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382451+0000", 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382459+0000", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6769999999999995e-06 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382471+0000", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1583000000000001e-05 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382478+0000", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2799999999999998e-06 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382511+0000", 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3467999999999999e-05 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382524+0000", 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2277e-05 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:155938 5.0 e41/17 5:0b55b557:::benchmark_data_smithi045_43640_object7564:head v 41'9793, mlcod=41'9790)", 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.382489+0000", 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0024098499999999998, 2024-04-26T12:11:15.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028460410000000001, 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382489+0000", 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382489+0000", 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382489+0000", 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382493+0000", 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9790000000000004e-06 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382500+0000", 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1160000000000001e-06 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382506+0000", 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384020+0000", 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001513992 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384041+0000", 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:155945 5.4 e41/17 5:2abfef9e:::benchmark_data_smithi045_43640_object7571:head v 41'9820, mlcod=41'9817)", 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.382511+0000", 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00238791, 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028829379999999998, 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382511+0000", 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382511+0000", 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382511+0000", 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382518+0000", 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0110000000000003e-06 2024-04-26T12:11:15.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382525+0000", 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4850000000000003e-06 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382530+0000", 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.865e-06 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382618+0000", 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8034000000000005e-05 2024-04-26T12:11:15.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382638+0000", 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9726000000000001e-05 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:155946 5.8 e41/17 5:1e6aa803:::benchmark_data_smithi045_43640_object7572:head v 41'9553, mlcod=41'9548)", 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.382569+0000", 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023296599999999999, 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002888608, 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.419 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382569+0000", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382569+0000", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382569+0000", 2024-04-26T12:11:15.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382573+0000", 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2180000000000001e-06 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382584+0000", 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0664e-05 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382599+0000", 2024-04-26T12:11:15.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5418e-05 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384060+0000", 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001461345 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384076+0000", 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5801999999999999e-05 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155947 5.6 5:65eaf413:::benchmark_data_smithi045_43640_object7573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.382803+0000", 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020957480000000001, 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027315669999999998, 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155947 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382803+0000", 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382803+0000", 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382802+0000", 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382807+0000", 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.028e-06 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382816+0000", 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5289999999999997e-06 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.382823+0000", 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6239999999999996e-06 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385455+0000", 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002632087 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:155951 5.4 e41/17 5:28ab6aa7:::benchmark_data_smithi045_43640_object7577:head v 41'9821, mlcod=41'9817)", 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.384408+0000", 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00049118100000000004, 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001209938, 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384408+0000", 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384408+0000", 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384407+0000", 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384412+0000", 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.203e-06 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384420+0000", 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4669999999999998e-06 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384426+0000", 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.229e-06 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384738+0000", 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00031216000000000002 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384761+0000", 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2756999999999999e-05 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155950 5.5 5:a9b46406:::benchmark_data_smithi045_43640_object7576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.384761+0000", 2024-04-26T12:11:15.429 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00013791699999999999, 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00092644099999999996, 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155950 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384761+0000", 2024-04-26T12:11:15.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384761+0000", 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384760+0000", 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384765+0000", 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6189999999999999e-06 2024-04-26T12:11:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384779+0000", 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4287999999999999e-05 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.384788+0000", 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3860000000000007e-06 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385466+0000", 2024-04-26T12:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00067815099999999999 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385594+0000", 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012790100000000001 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:155954 5.5 5.5444cd75 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:15.385595+0000", 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9993038, 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000171006, 2024-04-26T12:11:15.433 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 155954 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385595+0000", 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385595+0000", 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385594+0000", 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385599+0000", 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8570000000000003e-06 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385607+0000", 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.422e-06 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:15.385615+0000", 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2609999999999996e-06 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:11:15.436 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:15.437 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:15.481 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:15.480+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:15.583 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:15.582+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:15.674 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:15.674 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:15.674 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:15.674 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:15.674 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:15.684 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:15.683+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:15.691 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:15.786 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:15.785+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:15.887 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:15.886+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:15.893 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:15.893 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:15.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.639653355999997, 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.894 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:15.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:15.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:15.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:15.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.913850087, 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.901 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:15.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:15.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.907 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.422661055999999, 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.908 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.420309679999999, 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:15.916 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.418666809000001, 2024-04-26T12:11:15.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.407211397000001, 2024-04-26T12:11:15.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:15.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:15.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.40395642, 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:15.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:15.933 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:15.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.401458744999999, 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:15.934 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:15.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:15.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:15.939 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.400775444000001, 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:15.942 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:15.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.398654927999999, 2024-04-26T12:11:15.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:15.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.950 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.396440917, 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:15.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:107132 5.2 5:484a2627:::benchmark_data_smithi045_43640_object107131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.877032088, 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020502233000000002, 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 107132 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.956 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013596+0000", 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013700+0000", 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104194 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013728+0000", 2024-04-26T12:11:15.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8391e-05 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.013738+0000", 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6069999999999997e-06 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018327+0000", 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045894550000000001 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.018475+0000", 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014772799999999999 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.033956+0000", 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015480908999999999 2024-04-26T12:11:15.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034026+0000", 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0470999999999997e-05 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:54.034098+0000", 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2101999999999995e-05 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.715941361999999, 2024-04-26T12:11:15.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:15.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:15.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.6250495409999992, 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.968 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:15.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:15.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:15.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144974 5.c 5:3ab50d54:::benchmark_data_smithi045_43640_object144973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.844053701, 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020753246999999999, 2024-04-26T12:11:15.974 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144974 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046574+0000", 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046674+0000", 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9868e-05 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046683+0000", 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046689+0000", 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2729999999999999e-06 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046767+0000", 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7288999999999998e-05 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046944+0000", 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017754700000000001 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067230+0000", 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020285184000000001 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067283+0000", 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3986000000000001e-05 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067328+0000", 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4404999999999999e-05 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.982 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144975 5.c 5:3d48118b:::benchmark_data_smithi045_43640_object144974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8439269469999999, 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020691542, 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144975 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.983 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046764+0000", 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046771+0000", 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4390000000000003e-06 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046778+0000", 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050750+0000", 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039718959999999999 2024-04-26T12:11:15.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050862+0000", 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000111906 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067333+0000", 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016471171999999999 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067356+0000", 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2840000000000002e-05 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067393+0000", 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6885999999999999e-05 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:15.988 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8422941310000001, 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:15.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:15.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144971 5.4 e40/17 5:25843963:::benchmark_data_smithi045_43640_object144970:head v 40'9138, mlcod=40'9135)", 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8420486360000004, 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020798423, 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048579+0000", 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:15.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048647+0000", 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7360000000000006e-05 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048655+0000", 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8970000000000008e-06 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048661+0000", 2024-04-26T12:11:15.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062933+0000", 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014272093 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062953+0000", 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0778e-05 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069352+0000", 2024-04-26T12:11:15.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063989310000000001 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069378+0000", 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5831999999999999e-05 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8405157049999996, 2024-04-26T12:11:15.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:15.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:16.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.8379915110000002, 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:16.005 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.006 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.006 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.006 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:16.007 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:16.008 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:16.006+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:16.108 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:16.107+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:16.146 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:11:16.182 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158137 5.f 5:f76e935a:::benchmark_data_smithi045_43640_object9763:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.179497+0000", 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0018991710000000001, 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00191998, 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.183 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158137 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179497+0000", 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179497+0000", 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179497+0000", 2024-04-26T12:11:16.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179501+0000", 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5329999999999996e-06 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179510+0000", 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7090000000000008e-06 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179516+0000", 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5069999999999997e-06 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179545+0000", 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8909000000000001e-05 2024-04-26T12:11:16.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179629+0000", 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3381999999999996e-05 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158141 5.0 5:08256768:::benchmark_data_smithi045_43640_object9767:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.179993+0000", 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001403811, 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014710509999999999, 2024-04-26T12:11:16.187 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158141 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179993+0000", 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179993+0000", 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179992+0000", 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179995+0000", 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7980000000000001e-06 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180001+0000", 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3419999999999996e-06 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180005+0000", 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0749999999999999e-06 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180044+0000", 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8587999999999997e-05 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180166+0000", 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012165199999999999 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180283+0000", 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117102 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158142 5.f 5.727e57bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.192 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.180094+0000", 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0013026960000000001, 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014141679999999999, 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158142 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180094+0000", 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180094+0000", 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180093+0000", 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180096+0000", 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7520000000000001e-06 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180102+0000", 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6790000000000002e-06 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180105+0000", 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158143 5.f 5.387a136f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.180192+0000", 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001204898, 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013551139999999999, 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.196 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158143 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180192+0000", 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180192+0000", 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180191+0000", 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180194+0000", 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8449999999999999e-06 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180200+0000", 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9449999999999998e-06 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.180204+0000", 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.738e-06 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158144 5.f 5.7f9d32ef (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.181205+0000", 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.000191573, 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0003745, 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.200 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158144 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181205+0000", 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181205+0000", 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181204+0000", 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181208+0000", 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7400000000000002e-06 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181215+0000", 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181219+0000", 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9940000000000002e-06 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.203 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:158120 5.0 e42/17)", 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.181572+0000", 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998245, 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9069999999999997e-05, 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181572+0000", 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181572+0000", 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181572+0000", 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181574+0000", 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.503e-06 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181579+0000", 2024-04-26T12:11:16.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.967e-06 2024-04-26T12:11:16.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.207 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.207 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.207 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181583+0000", 2024-04-26T12:11:16.207 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6509999999999999e-06 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:158130 5.0 e42/17)", 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.181593+0000", 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998035, 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4998000000000003e-05, 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.208 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181593+0000", 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181593+0000", 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.209 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181593+0000", 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181595+0000", 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181600+0000", 2024-04-26T12:11:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181602+0000", 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6089999999999999e-06 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:158131 5.4 e42/17 ondisk, result = 0)", 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.181605+0000", 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997921, 2024-04-26T12:11:16.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011791899999999999, 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181605+0000", 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181605+0000", 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181604+0000", 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181606+0000", 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2300000000000001e-06 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181608+0000", 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.791e-06 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.213 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181610+0000", 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0810000000000001e-06 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181646+0000", 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5639999999999998e-05 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.181654+0000", 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1990000000000006e-06 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158120 5.0 5:03eaf405:::benchmark_data_smithi045_43640_object9746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.172987+0000", 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0084099569999999992, 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0087939560000000003, 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158120 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.215 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.172987+0000", 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.172987+0000", 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.172986+0000", 2024-04-26T12:11:16.216 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.172989+0000", 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1700000000000001e-06 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.172996+0000", 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9280000000000004e-06 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.217 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.173000+0000", 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.173026+0000", 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5483e-05 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.173102+0000", 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6545999999999995e-05 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.173163+0000", 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0677000000000002e-05 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.174942+0000", 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001778544 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.219 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158125 5.b 5:d781baf9:::benchmark_data_smithi045_43640_object9751:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.175097+0000", 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0062996500000000004, 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067459470000000004, 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158125 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.220 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175097+0000", 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175097+0000", 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175096+0000", 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175100+0000", 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2890000000000002e-06 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175106+0000", 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0499999999999997e-06 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175113+0000", 2024-04-26T12:11:16.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.177251+0000", 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021380180000000002 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.177369+0000", 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117824 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.177470+0000", 2024-04-26T12:11:16.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010145900000000001 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.179344+0000", 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018737020000000001 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:158130 5.0 5:0ded9c63:::benchmark_data_smithi045_43640_object9756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:16.175261+0000", 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0061356129999999998, 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066324540000000003, 2024-04-26T12:11:16.224 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 158130 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175261+0000", 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175261+0000", 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175261+0000", 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175263+0000", 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1859999999999999e-06 2024-04-26T12:11:16.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175268+0000", 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175272+0000", 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4539999999999999e-06 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175294+0000", 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1829000000000001e-05 2024-04-26T12:11:16.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175368+0000", 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4187e-05 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.175451+0000", 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3140999999999996e-05 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:16.176642+0000", 2024-04-26T12:11:16.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001190817 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 11 2024-04-26T12:11:16.229 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:16.230 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:16.231 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:16.229+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:16.331 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:16.330+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:16.409 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:16.409 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:16.409 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:16.409 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:16.409 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:16.422 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:16.432 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:16.431+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:16.534 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:16.533+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:16.634 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:16.633+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:16.642 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:16.642 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:16.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:16.642 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:16.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.642 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.170537059000001, 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.643 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.168921816000001, 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.648 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:16.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.653 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.166557521000001, 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.654 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:16.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.252506208, 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:16.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:16.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:16.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:16.665 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.157826627999999, 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:16.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:16.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.152618857, 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:16.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:16.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.678 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.149419899000002, 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:16.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:16.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.149168091, 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.684 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:16.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:16.688 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.690 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.146512052999999, 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.691 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:16.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:16.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:16.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:16.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.145005284, 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:16.696 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:16.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.705 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.142394831000001, 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.706 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:16.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:16.711 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 19.295792171999999, 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:16.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:16.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:16.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:16.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.344333046999999, 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.718 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:16.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:16.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:16.723 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.5926092360000004, 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.724 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:16.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:16.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:16.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.592500619, 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.730 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.734 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.5920920760000001, 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.736 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:16.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:16.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:16.742 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.5866369159999998, 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:16.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:16.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.746 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 5.4599173069999996, 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.748 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.8538715779999997, 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.8537121599999997, 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.759 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:16.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:16.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:16.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:16.764 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:16.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:16.766 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:16.764+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:16.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:16.867 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:16.866+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:16.937 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:160350 5.c 5:3a20aa2c:::benchmark_data_smithi045_43640_object11976:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.955188+0000", 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001285778, 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013127690000000001, 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.958 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 160350 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955188+0000", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955188+0000", 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955188+0000", 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955197+0000", 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8320000000000001e-06 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955208+0000", 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.058e-05 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955218+0000", 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.029e-05 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955261+0000", 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2293999999999999e-05 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955337+0000", 2024-04-26T12:11:16.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6224999999999996e-05 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:160346 5.4 e42/17 5:215f195c:::benchmark_data_smithi045_43640_object11972:head v 42'10105, mlcod=42'10102)", 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.955205+0000", 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001269306, 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013732970000000001, 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955205+0000", 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955205+0000", 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955204+0000", 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955209+0000", 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955217+0000", 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3489999999999992e-06 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955222+0000", 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6609999999999999e-06 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955253+0000", 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0494e-05 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955271+0000", 2024-04-26T12:11:16.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8777999999999999e-05 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:160354 5.5 5.bccb1065 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.956112+0000", 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00036177399999999998, 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00052954100000000002, 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:16.966 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 160354 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956112+0000", 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956112+0000", 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956112+0000", 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956116+0000", 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:11:16.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956134+0000", 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7496e-05 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956141+0000", 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9859999999999997e-06 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:160355 5.8 e42/17 5:133f3ddb:::benchmark_data_smithi045_43640_object11981:head v 42'9804, mlcod=42'9802)", 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.956564+0000", 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999104, 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014912000000000001, 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956564+0000", 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956564+0000", 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956563+0000", 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956568+0000", 2024-04-26T12:11:16.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956575+0000", 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.455e-06 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956579+0000", 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956608+0000", 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9269e-05 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956620+0000", 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1768e-05 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:160340 5.5 5:a92587dd:::benchmark_data_smithi045_43640_object11966:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.950953+0000", 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0055214069999999999, 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005848504, 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 160340 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.950953+0000", 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.950953+0000", 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.950952+0000", 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.950957+0000", 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5879999999999999e-06 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.950965+0000", 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2239999999999995e-06 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.950972+0000", 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1010000000000003e-06 2024-04-26T12:11:16.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.951010+0000", 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7939999999999999e-05 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.951125+0000", 2024-04-26T12:11:16.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114887 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:160344 5.c 5:36472191:::benchmark_data_smithi045_43640_object11970:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.953178+0000", 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003296696, 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003701728, 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 160344 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953178+0000", 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953178+0000", 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953177+0000", 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953181+0000", 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6369999999999998e-06 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953191+0000", 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4909999999999994e-06 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953199+0000", 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3219999999999993e-06 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953240+0000", 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1032999999999998e-05 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953374+0000", 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000134184 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956802+0000", 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0034277140000000001 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956846+0000", 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3804999999999998e-05 2024-04-26T12:11:16.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:160345 5.4 e42/17 5:28dd11cd:::benchmark_data_smithi045_43640_object11971:head v 42'10104, mlcod=42'10102)", 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.953505+0000", 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029691890000000001, 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00345854, 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953505+0000", 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953505+0000", 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953504+0000", 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953510+0000", 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1909999999999999e-06 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953516+0000", 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3289999999999999e-06 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953520+0000", 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.25e-06 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953548+0000", 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7603999999999999e-05 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.953560+0000", 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2311e-05 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956955+0000", 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033945609999999999 2024-04-26T12:11:16.986 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:160347 5.3 5:cc195bfd:::benchmark_data_smithi045_43640_object11973:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:16.954893+0000", 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001581708, 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021332510000000001, 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 160347 2024-04-26T12:11:16.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.988 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:16.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:16.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954893+0000", 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954893+0000", 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954892+0000", 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954896+0000", 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5410000000000002e-06 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954903+0000", 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.153e-06 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954909+0000", 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.186e-06 2024-04-26T12:11:16.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.954935+0000", 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6038e-05 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.955027+0000", 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2313999999999997e-05 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:16.956994+0000", 2024-04-26T12:11:16.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019665490000000002 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 8 2024-04-26T12:11:16.992 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:16.993 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:16.994 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:16.992+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:16.994 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:16.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:16.995 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:16.995 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:16.995 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:16.996 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:17.094 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:17.093+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:17.193 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:17.193 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:17.195 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:17.194+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:17.211 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:17.296 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:17.295+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:17.396 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:17.395+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:17.448 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:17.448 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:17.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:17.506 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:17.505+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:17.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-26T12:11:17.599 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:17.598+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:17.643 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:17.643 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:17.657 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:17.701 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:17.699+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:17.802 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:17.801+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:17.878 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:17.878 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:17.892 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:17.903 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:17.902+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:18.003 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:18.002+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:18.063 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:18.063 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:18.079 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:18.103 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:18.102+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:18.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:11:18.204 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:18.203+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:18.278 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:18.278 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:18.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:18.339 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:18.337+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:18.408 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:18.405+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:18.500 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:18.500 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:18.506 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:18.505+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:18.516 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:18.607 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:18.606+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:18.708 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:18.707+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:18.753 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:18.754 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:18.768 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:18.812 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:18.811+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:18.909 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:18.908+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:18.945 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:18.946 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:18.960 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:18.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:19.044 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.043+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.112 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.110+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:11:19.178 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:19.181 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:19.181 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:19.181 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:19.181 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:19.182 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:19.195 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:19.201 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:19.201 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:19.201 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:19.201 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:19.204 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:19.204 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:19.213 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:19.212+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:19.313 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.312+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.414 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.413+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.423 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:19.423 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:19.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:19.423 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:19.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.424 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:19.424 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:19.424 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.950922931999997, 2024-04-26T12:11:19.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:19.425 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.425 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.426 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:19.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.426 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.949307689000001, 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.433 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:19.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 33.946943394000002, 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:19.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:19.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.032892081, 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.445 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:19.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:19.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:19.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:19.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.451 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.938212500999999, 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.452 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:19.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:19.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.93300473, 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:19.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.929805772000002, 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:19.469 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.929553964, 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:19.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:19.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:19.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:19.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.926897925999999, 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.476 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:19.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.925391157, 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:19.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.922780704000001, 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.488 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:19.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.076178044999999, 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:19.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:19.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.124718919999999, 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:19.499 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:19.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.3729951089999997, 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:19.505 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:19.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:19.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.3728864919999992, 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:19.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:19.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.3724779490000003, 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:19.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:19.523 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.367022789, 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:19.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:19.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 8.2403031799999997, 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.529 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:19.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:19.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:19.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.6342574509999999, 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:19.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:19.539 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 7.6340980329999999, 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.540 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.544 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.545 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:19.545 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:19.545 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:19.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:19.547 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.545+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.647 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.646+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.740 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:19.740 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:19.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.740 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168094 5.3 5:cd8184c9:::benchmark_data_smithi045_43640_object19720:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:19.740 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:19.735940+0000", 2024-04-26T12:11:19.740 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0034981790000000001, 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035078900000000001, 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168094 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.735940+0000", 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.735940+0000", 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.735939+0000", 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.735943+0000", 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7349999999999998e-06 2024-04-26T12:11:19.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.735952+0000", 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0450000000000006e-06 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.735959+0000", 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737245+0000", 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012863180000000001 2024-04-26T12:11:19.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737373+0000", 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000127918 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739341+0000", 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019678180000000001 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739380+0000", 2024-04-26T12:11:19.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9214000000000001e-05 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739448+0000", 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7285000000000004e-05 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:168089 5.e e43/17 5:7d9fcb42:::benchmark_data_smithi045_43640_object19715:head v 43'10524, mlcod=43'10521)", 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:19.737647+0000", 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001791199, 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018917280000000001, 2024-04-26T12:11:19.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737647+0000", 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737647+0000", 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737646+0000", 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737652+0000", 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737662+0000", 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0390999999999999e-05 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737669+0000", 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2979999999999997e-06 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737702+0000", 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3065999999999998e-05 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.737720+0000", 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8196e-05 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.748 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168097 5.a 5:52609efe:::benchmark_data_smithi045_43640_object19723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:19.738695+0000", 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00074247899999999999, 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00089170700000000005, 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168097 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.749 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.738695+0000", 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.738695+0000", 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.738694+0000", 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.738700+0000", 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.772e-06 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.738711+0000", 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0974e-05 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.738720+0000", 2024-04-26T12:11:19.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4719999999999995e-06 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739016+0000", 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00029604799999999998 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739135+0000", 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000119617 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739202+0000", 2024-04-26T12:11:19.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7062000000000003e-05 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168101 5.a 5.c96b27ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:19.739254+0000", 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00018394599999999999, 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00038472799999999998, 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:19.753 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168101 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739254+0000", 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739254+0000", 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739253+0000", 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739259+0000", 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4330000000000003e-06 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739268+0000", 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4790000000000002e-06 2024-04-26T12:11:19.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739277+0000", 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0489999999999993e-06 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168102 5.1 5:8b3f7fa4:::benchmark_data_smithi045_43640_object19728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:19.739557+0000", 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9998813, 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011801199999999999, 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:19.756 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168102 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739557+0000", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739557+0000", 2024-04-26T12:11:19.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739556+0000", 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739560+0000", 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4320000000000001e-06 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739569+0000", 2024-04-26T12:11:19.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3100000000000001e-06 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739575+0000", 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6839999999999999e-06 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:19.739613+0000", 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7670999999999999e-05 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:19.759 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:19.760 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 5 2024-04-26T12:11:19.760 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:19.761 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.760+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.762 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:19.862 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.861+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.960 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:19.960 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:19.960 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:19.960 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:19.961 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:19.963 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:19.962+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:19.976 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:20.064 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:20.063+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:20.164 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:20.163+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:20.180 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 44.917054632000003, 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.181 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:20.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:20.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.191251362999999, 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.700062332000002, 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.192 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.697710956000002, 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:20.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:20.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.696068085, 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:20.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:20.207 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.207 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.207 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.207 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.684612673, 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:20.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.212 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.681357695999999, 2024-04-26T12:11:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:20.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:20.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:20.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:20.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:20.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:20.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:20.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:20.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:20.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:20.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:20.222 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.222 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.222 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.223 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:20.223 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:20.223 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.678860020999998, 2024-04-26T12:11:20.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:20.223 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.224 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.224 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.224 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.224 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.224 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:20.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.225 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:20.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:20.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:20.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:20.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:20.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:20.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:20.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:20.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:20.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:20.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:20.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:20.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:20.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:20.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:20.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:20.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:20.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:20.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:20.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:20.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.234 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.235 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:20.235 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:20.235 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.67817672, 2024-04-26T12:11:20.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:20.235 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.235 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.236 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:20.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:20.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:20.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:20.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:20.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:20.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:20.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:20.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:20.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:20.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:20.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:20.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.676056203999998, 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.673842192999999, 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:20.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.993342638000001, 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:20.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:20.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:20.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 12.902450817, 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.257 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144974 5.c 5:3ab50d54:::benchmark_data_smithi045_43640_object144973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.1214549770000009, 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020753246999999999, 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.262 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144974 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046574+0000", 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046674+0000", 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9868e-05 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046683+0000", 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046689+0000", 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2729999999999999e-06 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046767+0000", 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7288999999999998e-05 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046944+0000", 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017754700000000001 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067230+0000", 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020285184000000001 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067283+0000", 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3986000000000001e-05 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067328+0000", 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4404999999999999e-05 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.266 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144975 5.c 5:3d48118b:::benchmark_data_smithi045_43640_object144974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.1213282230000008, 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020691542, 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144975 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.267 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046764+0000", 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046771+0000", 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4390000000000003e-06 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046778+0000", 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:11:20.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050750+0000", 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039718959999999999 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050862+0000", 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000111906 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067333+0000", 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016471171999999999 2024-04-26T12:11:20.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067356+0000", 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2840000000000002e-05 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067393+0000", 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6885999999999999e-05 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.271 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.119695407, 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:20.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:20.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144971 5.4 e40/17 5:25843963:::benchmark_data_smithi045_43640_object144970:head v 40'9138, mlcod=40'9135)", 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.1194499120000003, 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020798423, 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048579+0000", 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048647+0000", 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7360000000000006e-05 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048655+0000", 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8970000000000008e-06 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048661+0000", 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062933+0000", 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014272093 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062953+0000", 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0778e-05 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069352+0000", 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063989310000000001 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069378+0000", 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5831999999999999e-05 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.1179169810000005, 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.1153927869999993, 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:20.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:20.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:20.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.13512431, 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:20.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:20.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:20.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:20.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:20.292 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:20.294 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:20.292+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:20.294 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:20.395 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:20.393+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170138 5.e 5:75430200:::benchmark_data_smithi045_43640_object21764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.462716+0000", 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0066227229999999996, 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0066438019999999999, 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.471 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170138 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462716+0000", 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462716+0000", 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462716+0000", 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462718+0000", 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9879999999999999e-06 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462723+0000", 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7129999999999996e-06 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462726+0000", 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.337e-06 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462762+0000", 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5970999999999998e-05 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.462899+0000", 2024-04-26T12:11:20.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000137379 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.463016+0000", 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117006 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.464642+0000", 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016253140000000001 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170148 5.e 5:7960ebbc:::benchmark_data_smithi045_43640_object21774:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.465410+0000", 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003928529, 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040265659999999997, 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.476 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170148 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465410+0000", 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465410+0000", 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465410+0000", 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465414+0000", 2024-04-26T12:11:20.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.121e-06 2024-04-26T12:11:20.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465422+0000", 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8730000000000007e-06 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465428+0000", 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.122e-06 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465466+0000", 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8631000000000003e-05 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465595+0000", 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012863800000000001 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.465716+0000", 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012081700000000001 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467099+0000", 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013825529999999999 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170153 5.f 5:ff719b89:::benchmark_data_smithi045_43640_object21779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.467515+0000", 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001823821, 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019850029999999999, 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.482 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170153 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467515+0000", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467515+0000", 2024-04-26T12:11:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467514+0000", 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467519+0000", 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0309999999999998e-06 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467532+0000", 2024-04-26T12:11:20.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2758999999999999e-05 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467541+0000", 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8529999999999998e-06 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467580+0000", 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8658000000000002e-05 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.467706+0000", 2024-04-26T12:11:20.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012672900000000001 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170155 5.8 5:18a2402d:::benchmark_data_smithi045_43640_object21781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.468799+0000", 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00054020299999999995, 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00076678, 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.486 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170155 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468799+0000", 2024-04-26T12:11:20.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468799+0000", 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468798+0000", 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468803+0000", 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1540000000000001e-06 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468816+0000", 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2775000000000001e-05 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468823+0000", 2024-04-26T12:11:20.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6690000000000006e-06 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468858+0000", 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4969999999999999e-05 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468936+0000", 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7558000000000005e-05 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.468996+0000", 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0269999999999997e-05 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170156 5.f 5.f77ddbaf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.469614+0000", 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997253, 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3905e-05, 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.491 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170156 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469614+0000", 2024-04-26T12:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469614+0000", 2024-04-26T12:11:20.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469613+0000", 2024-04-26T12:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469617+0000", 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2919999999999997e-06 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469625+0000", 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8550000000000002e-06 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469630+0000", 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1329999999999998e-06 2024-04-26T12:11:20.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469660+0000", 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0272000000000001e-05 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170158 5.4 5:279ee96a:::benchmark_data_smithi045_43640_object21784:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.469671+0000", 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9996676, 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1322999999999995e-05, 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.496 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "reached pg", 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170158 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469671+0000", 2024-04-26T12:11:20.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469671+0000", 2024-04-26T12:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469671+0000", 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469673+0000", 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9390000000000002e-06 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469678+0000", 2024-04-26T12:11:20.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.011e-06 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469682+0000", 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3400000000000002e-06 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469718+0000", 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6671000000000002e-05 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:170159 5.4 5.b02000d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:20.469761+0000", 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9995775, 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6369000000000002e-05, 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 170159 2024-04-26T12:11:20.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469761+0000", 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469761+0000", 2024-04-26T12:11:20.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469761+0000", 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469763+0000", 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469767+0000", 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7979999999999999e-06 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:20.469770+0000", 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4850000000000001e-06 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 7 2024-04-26T12:11:20.504 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:20.506 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:20.506 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:20.504+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:20.608 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:20.606+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:20.709 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:20.708+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:20.728 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:20.728 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:20.728 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:20.728 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:20.728 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:20.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:20.810 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:20.809+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:20.914 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:20.911+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.493928048000001, 2024-04-26T12:11:20.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:20.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:20.970 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.492312804999997, 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:20.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:20.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:20.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.489948509999998, 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:20.976 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.575897197, 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.481217616999999, 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.987 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:20.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.476009846, 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:20.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:20.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.472810888000001, 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:20.998 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:20.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:21.003 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.47255908, 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:21.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:21.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:21.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:21.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:21.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.469903041999999, 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.009 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.468396273, 2024-04-26T12:11:21.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:21.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.465785820000001, 2024-04-26T12:11:21.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.026 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 23.619183160999999, 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.027 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:21.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:21.032 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.667724035999999, 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:21.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:21.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:21.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.9160002249999994, 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.038 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.043 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.9158916080000008, 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:21.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:21.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:21.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:21.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:21.048 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.9154830650000001, 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:21.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:21.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:21.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:21.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:21.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.9100279049999997, 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.054 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:21.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.7833082959999995, 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1772625669999996, 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.069 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1771031490000006, 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:21.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:21.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:21.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:21.074 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:21.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:21.076 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.074+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:11:21.176 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.175+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.205 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:21.277 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.276+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.280 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:21.280 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:172488 5.c 5:3a8771e2:::benchmark_data_smithi045_43640_object24114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:21.274812+0000", 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0047926619999999996, 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0047979269999999996, 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 172488 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:21.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.274812+0000", 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.274812+0000", 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.274812+0000", 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.274814+0000", 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0640000000000001e-06 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.274841+0000", 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6645e-05 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.274850+0000", 2024-04-26T12:11:21.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3079999999999997e-06 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.275330+0000", 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000479772 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.275446+0000", 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011605800000000001 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279507+0000", 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040612920000000002 2024-04-26T12:11:21.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279547+0000", 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9731000000000003e-05 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:21.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279610+0000", 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3387999999999997e-05 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:172486 5.8 e43/17 5:1eee55fe:::benchmark_data_smithi045_43640_object24112:head v 43'10532, mlcod=43'10528)", 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:21.276929+0000", 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0026763249999999998, 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027773490000000001, 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:21.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.276929+0000", 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.276929+0000", 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.276928+0000", 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.276932+0000", 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6210000000000001e-06 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.276974+0000", 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1804000000000002e-05 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.276979+0000", 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8280000000000002e-06 2024-04-26T12:11:21.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277546+0000", 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00056745600000000004 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277563+0000", 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7229999999999999e-05 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:172489 5.8 e43/17 5:1eb5dc06:::benchmark_data_smithi045_43640_object24115:head v 43'10533, mlcod=43'10528)", 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:21.277493+0000", 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0021121600000000001, 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022839039999999998, 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277493+0000", 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277493+0000", 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277492+0000", 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277498+0000", 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4179999999999996e-06 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277507+0000", 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0739999999999999e-06 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277513+0000", 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279370+0000", 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018571530000000001 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279380+0000", 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0468e-05 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.293 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:172491 5.b e43/17 5:deed6da1:::benchmark_data_smithi045_43640_object24117:head v 43'10682, mlcod=43'10679)", 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:21.277520+0000", 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020850030000000002, 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022957070000000001, 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:21.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277520+0000", 2024-04-26T12:11:21.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277520+0000", 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277520+0000", 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277523+0000", 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.704e-06 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277529+0000", 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2669999999999997e-06 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277533+0000", 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6949999999999999e-06 2024-04-26T12:11:21.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277592+0000", 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8235000000000001e-05 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277609+0000", 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7232999999999999e-05 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:172494 5.7 5:e06d1dea:::benchmark_data_smithi045_43640_object24120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:21.277874+0000", 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0017309440000000001, 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019879580000000002, 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 172494 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:21.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277874+0000", 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277874+0000", 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277873+0000", 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277878+0000", 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5870000000000003e-06 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277888+0000", 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0115000000000001e-05 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277895+0000", 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9759999999999998e-06 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.277938+0000", 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3281000000000001e-05 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.278064+0000", 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012553600000000001 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:172497 5.4 e43/17 5:212abf8e:::benchmark_data_smithi045_43640_object24123:head v 43'10930, mlcod=43'10928)", 2024-04-26T12:11:21.302 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:21.279709+0000", 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9998956, 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000203916, 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279709+0000", 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279709+0000", 2024-04-26T12:11:21.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279709+0000", 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279715+0000", 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.657e-06 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279725+0000", 2024-04-26T12:11:21.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7839999999999998e-06 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279732+0000", 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2640000000000002e-06 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:21.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279777+0000", 2024-04-26T12:11:21.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4614999999999999e-05 2024-04-26T12:11:21.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:21.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:21.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:21.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:21.279796+0000", 2024-04-26T12:11:21.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9049999999999999e-05 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 6 2024-04-26T12:11:21.308 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:21.309 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:21.378 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.377+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.391 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:21.415 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:21.418 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:21.419 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:21.479 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.478+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.509 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:21.509 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:21.522 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:21.580 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.579+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.681 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.680+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.728 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:21.728 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:21.739 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:21.782 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:21.781+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:21.883 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:21.882+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:21.910 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:21.911 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:21.925 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:22.011 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.010+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.086 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.085+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:11:22.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:22.204 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.203+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.287 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.286+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:22.388 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.387+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:22.489 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.488+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.590 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.589+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.600 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:22.600 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:22.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:22.691 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:22.690+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:22.792 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.791+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.812 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:22.812 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:22.825 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:22.893 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:22.892+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:22.996 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:22.994+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.070 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:23.070 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:23.084 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:23.127 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:23.125+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.198 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:23.196+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.262 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:23.262 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:23.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:23.298 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:23.297+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.399 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:23.398+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-26T12:11:23.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:23.457 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:23.458 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:23.473 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:23.500 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:23.499+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.593 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:23.601 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:23.600+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:23.615 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:23.619 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:23.619 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:23.657 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:23.657 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:23.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.185466384000001, 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.658 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:23.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:23.663 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.183851140999998, 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:23.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:23.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:23.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:23.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.181486845999999, 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.669 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:23.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.267435532999997, 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:23.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:23.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.172755952999999, 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:23.680 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.683 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.683 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:23.683 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:23.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.683 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:23.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.167548181999997, 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.688 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:23.689 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:23.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.691 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.164349223999999, 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:23.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:23.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.698 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:23.699 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.164097415999997, 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.700 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.701 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:23.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.161441377999999, 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.705 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:23.706 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.707 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.710 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.159934608999997, 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:23.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:23.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.716 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.157324156000001, 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.718 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.721 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:23.722 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.310721496999999, 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:23.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:23.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.727 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.359262372, 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:23.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.607538561, 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:23.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:23.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.739 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.607429944, 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.740 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.607021401000001, 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.746 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:23.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.601566241, 2024-04-26T12:11:23.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:23.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:23.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:23.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 12.474846632, 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.757 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:23.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.762 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 11.868800903, 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:23.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:23.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:23.767 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 11.868641484999999, 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:23.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:23.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:23.772 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:23.774 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:23.774 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:23.772+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:23.874 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:23.873+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:23.973 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:23.973 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:23.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.973 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180018 5.e e44/17 5:7691bd64:::benchmark_data_smithi045_43640_object31644:head v 44'11258, mlcod=44'11256)", 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.961514+0000", 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00083489999999999997, 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00086001299999999997, 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961514+0000", 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961514+0000", 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961514+0000", 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961517+0000", 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7980000000000001e-06 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961521+0000", 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6469999999999997e-06 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961525+0000", 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7050000000000001e-06 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.962195+0000", 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00067040800000000005 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.962215+0000", 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9868999999999999e-05 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:180002 5.6 5:6716e82c:::benchmark_data_smithi045_43640_object31628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958388+0000", 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039607970000000003, 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040546489999999996, 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.977 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 180002 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958388+0000", 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958388+0000", 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958387+0000", 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958392+0000", 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8620000000000002e-06 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:23.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958401+0000", 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0010000000000007e-06 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958409+0000", 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4440000000000002e-06 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958440+0000", 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1278000000000001e-05 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958551+0000", 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110902 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:180003 5.2 5:44061fd0:::benchmark_data_smithi045_43640_object31629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958420+0000", 2024-04-26T12:11:23.981 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039293469999999997, 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004095179, 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 180003 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958420+0000", 2024-04-26T12:11:23.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958420+0000", 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958419+0000", 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958422+0000", 2024-04-26T12:11:23.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958429+0000", 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7519999999999999e-06 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958434+0000", 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6899999999999997e-06 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:23.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958478+0000", 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.354e-05 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958611+0000", 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000133375 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:180004 5.6 5:66e736c6:::benchmark_data_smithi045_43640_object31630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958442+0000", 2024-04-26T12:11:23.985 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039072810000000003, 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041450339999999997, 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 180004 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958442+0000", 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958442+0000", 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958441+0000", 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958443+0000", 2024-04-26T12:11:23.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2290000000000002e-06 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958451+0000", 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958456+0000", 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2329999999999997e-06 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:23.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.960333+0000", 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00187762 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.960472+0000", 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013867299999999999 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:180006 5.c 5:3ef2730f:::benchmark_data_smithi045_43640_object31632:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958482+0000", 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0038669059999999998, 2024-04-26T12:11:23.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041780630000000001, 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 180006 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958482+0000", 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958482+0000", 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958482+0000", 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958484+0000", 2024-04-26T12:11:23.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2299999999999998e-06 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958490+0000", 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958495+0000", 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3059999999999997e-06 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:23.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958529+0000", 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4374e-05 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958654+0000", 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000124187 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:180014 5.2 5:41f8b392:::benchmark_data_smithi045_43640_object31640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:23.993 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958506+0000", 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0038427079999999998, 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042260379999999997, 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 180014 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958506+0000", 2024-04-26T12:11:23.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958506+0000", 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958506+0000", 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958508+0000", 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6139999999999999e-06 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958515+0000", 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2899999999999999e-06 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958520+0000", 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5620000000000003e-06 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:23.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.960782+0000", 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022618740000000001 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.960921+0000", 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139321 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:180015 5.6 5:6967dc26:::benchmark_data_smithi045_43640_object31641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958526+0000", 2024-04-26T12:11:23.997 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0038232660000000001, 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042851110000000003, 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 180015 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958526+0000", 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958526+0000", 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958525+0000", 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958527+0000", 2024-04-26T12:11:23.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3149999999999999e-06 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958534+0000", 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0419999999999999e-06 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958538+0000", 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9520000000000002e-06 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.962610+0000", 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040720310000000003 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.962747+0000", 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000136799 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180007 5.8 e44/17 5:18342a4a:::benchmark_data_smithi045_43640_object31633:head v 44'10990, mlcod=44'10988)", 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958806+0000", 2024-04-26T12:11:24.001 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035430290000000001, 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040737719999999998, 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958806+0000", 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958806+0000", 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958805+0000", 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958811+0000", 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.75e-06 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958819+0000", 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6629999999999993e-06 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958825+0000", 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9000000000000003e-06 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.959296+0000", 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00047127999999999997 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.959313+0000", 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7618e-05 2024-04-26T12:11:24.004 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180001 5.4 e44/17 5:28bc9c62:::benchmark_data_smithi045_43640_object31627:head v 44'11435, mlcod=44'11433)", 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.958835+0000", 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035140029999999999, 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041034449999999998, 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958835+0000", 2024-04-26T12:11:24.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958835+0000", 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958835+0000", 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958838+0000", 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.613e-06 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958843+0000", 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1100000000000002e-06 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.958848+0000", 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2440000000000004e-06 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.960574+0000", 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0017262930000000001 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.960590+0000", 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6452000000000001e-05 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180009 5.4 e44/17 5:2d5eabd6:::benchmark_data_smithi045_43640_object31635:head v 44'11436, mlcod=44'11433)", 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.961404+0000", 2024-04-26T12:11:24.009 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00094534000000000003, 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0015930569999999999, 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961404+0000", 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961404+0000", 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961403+0000", 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961409+0000", 2024-04-26T12:11:24.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4559999999999997e-06 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961428+0000", 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8501000000000001e-05 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961434+0000", 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.489e-06 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.962635+0000", 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012007820000000001 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.962654+0000", 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9233e-05 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180008 5.8 e44/17 5:1402a6d9:::benchmark_data_smithi045_43640_object31634:head v 44'10991, mlcod=44'10988)", 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.961440+0000", 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00090850999999999996, 2024-04-26T12:11:24.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001614222, 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961440+0000", 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961440+0000", 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961440+0000", 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961444+0000", 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4659999999999999e-06 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.015 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961459+0000", 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5259000000000001e-05 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961464+0000", 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7700000000000001e-06 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961506+0000", 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2064999999999998e-05 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961524+0000", 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8204999999999999e-05 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180016 5.b e44/17 5:de0e24fc:::benchmark_data_smithi045_43640_object31642:head v 44'11154, mlcod=44'11152)", 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.961470+0000", 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00087904200000000002, 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001643558, 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.017 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961470+0000", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961470+0000", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961470+0000", 2024-04-26T12:11:24.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961479+0000", 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6679999999999996e-06 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961485+0000", 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4929999999999998e-06 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961489+0000", 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.799e-06 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961523+0000", 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4446999999999997e-05 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961543+0000", 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:180010 5.0 e44/17 5:0f942445:::benchmark_data_smithi045_43640_object31636:head v 44'11316, mlcod=44'11314)", 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:23.961497+0000", 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00085200200000000003, 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016749029999999999, 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961497+0000", 2024-04-26T12:11:24.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961497+0000", 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961497+0000", 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961500+0000", 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0910000000000001e-06 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961505+0000", 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7190000000000001e-06 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961508+0000", 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961567+0000", 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8675000000000003e-05 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:23.961585+0000", 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7666999999999999e-05 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:11:24.024 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:24.026 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:24.026 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:24.025+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:24.126 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:24.125+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:24.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:11:24.227 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:24.226+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:24.264 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:24.264 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:24.265 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:24.265 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:24.265 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:24.280 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:24.328 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:24.327+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:24.430 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:24.428+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:24.484 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:24.484 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:24.484 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 49.230489972000001, 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:24.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:24.487 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.488 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:24.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.490 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 44.504686702999997, 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.491 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.492 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:24.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:24.497 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.013497672, 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:24.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:24.500 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:24.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:24.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:24.503 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.011146296, 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.504 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:24.506 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.009503424999998, 2024-04-26T12:11:24.508 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.509 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.510 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.511 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.512 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.998048013000002, 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.514 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.515 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.516 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:24.517 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.994793035999997, 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:24.518 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:24.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:24.520 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:24.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.522 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.992295361000004, 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:24.525 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.526 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.991612060000001, 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:24.529 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.530 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.989491544000003, 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.532 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.533 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:24.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 34.987277532999997, 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.537 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.539 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.306777978, 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.541 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.543 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.544 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:24.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.215886157, 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.547 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.548 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.550 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:24.551 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144974 5.c 5:3ab50d54:::benchmark_data_smithi045_43640_object144973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.434890317000001, 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020753246999999999, 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.552 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144974 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.553 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046574+0000", 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046674+0000", 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9868e-05 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046683+0000", 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.554 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046689+0000", 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2729999999999999e-06 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046767+0000", 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7288999999999998e-05 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046944+0000", 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017754700000000001 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067230+0000", 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020285184000000001 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067283+0000", 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3986000000000001e-05 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067328+0000", 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4404999999999999e-05 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.556 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144975 5.c 5:3d48118b:::benchmark_data_smithi045_43640_object144974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.434763563000001, 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020691542, 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.557 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144975 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046701+0000", 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046764+0000", 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046771+0000", 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4390000000000003e-06 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046778+0000", 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9940000000000003e-06 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050750+0000", 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039718959999999999 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050862+0000", 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000111906 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067333+0000", 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016471171999999999 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067356+0000", 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2840000000000002e-05 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067393+0000", 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6885999999999999e-05 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.561 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.433130747, 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144971 5.4 e40/17 5:25843963:::benchmark_data_smithi045_43640_object144970:head v 40'9138, mlcod=40'9135)", 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:24.566 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.432885252, 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020798423, 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048579+0000", 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048647+0000", 2024-04-26T12:11:24.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7360000000000006e-05 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048655+0000", 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8970000000000008e-06 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048661+0000", 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062933+0000", 2024-04-26T12:11:24.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014272093 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062953+0000", 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0778e-05 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069352+0000", 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063989310000000001 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069378+0000", 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5831999999999999e-05 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.431352321, 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.571 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:24.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.428828126999999, 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:24.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:24.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:24.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:24.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.44855965, 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:24.585 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:24.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.590 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.591 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.591 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:24.591 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:24.591 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:24.592 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:24.591+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:24.593 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:24.692 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:24.691+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182277 5.8 5:13950d32:::benchmark_data_smithi045_43640_object33903:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.763022+0000", 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0073277990000000003, 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073527690000000003, 2024-04-26T12:11:24.772 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182277 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.763022+0000", 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.763022+0000", 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.763021+0000", 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.763025+0000", 2024-04-26T12:11:24.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0910000000000003e-06 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.763033+0000", 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0269999999999995e-06 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.763040+0000", 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3350000000000001e-06 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764065+0000", 2024-04-26T12:11:24.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00102472 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764185+0000", 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011956 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764294+0000", 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109483 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.768849+0000", 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045553970000000001 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182279 5.0 5:0f987869:::benchmark_data_smithi045_43640_object33905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.764125+0000", 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.006224444, 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0063509719999999999, 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182279 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764125+0000", 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764125+0000", 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764124+0000", 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764130+0000", 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764140+0000", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9650000000000003e-06 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764151+0000", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1484000000000001e-05 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765183+0000", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001031531 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765259+0000", 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6024000000000003e-05 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765322+0000", 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3268000000000005e-05 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.768865+0000", 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035435760000000001 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182281 5.b 5:d1d9ab44:::benchmark_data_smithi045_43640_object33907:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.765473+0000", 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0048766479999999999, 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0050666770000000003, 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182281 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765473+0000", 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765473+0000", 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765472+0000", 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765477+0000", 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7740000000000004e-06 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765489+0000", 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2683999999999999e-05 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.765497+0000", 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.593e-06 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.766213+0000", 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00071637800000000005 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.766324+0000", 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110383 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.766437+0000", 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011301199999999999 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.786 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:24.786 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769367+0000", 2024-04-26T12:11:24.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029303129999999999 2024-04-26T12:11:24.786 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.786 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.786 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182287 5.8 5:17d4596a:::benchmark_data_smithi045_43640_object33913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.767047+0000", 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0033026380000000001, 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035398040000000001, 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.788 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182287 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767047+0000", 2024-04-26T12:11:24.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767047+0000", 2024-04-26T12:11:24.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.791 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767046+0000", 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767051+0000", 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2650000000000004e-06 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767064+0000", 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3156000000000001e-05 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767072+0000", 2024-04-26T12:11:24.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2560000000000002e-06 2024-04-26T12:11:24.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767134+0000", 2024-04-26T12:11:24.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1820000000000001e-05 2024-04-26T12:11:24.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767214+0000", 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9338000000000005e-05 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767279+0000", 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:24.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770369+0000", 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030904119999999998 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.796 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182288 5.8 5:1f16d16f:::benchmark_data_smithi045_43640_object33914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.767081+0000", 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003267889, 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035517560000000001, 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.797 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182288 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767081+0000", 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767081+0000", 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767081+0000", 2024-04-26T12:11:24.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767084+0000", 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0130000000000002e-06 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767091+0000", 2024-04-26T12:11:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1729999999999998e-06 2024-04-26T12:11:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767097+0000", 2024-04-26T12:11:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.682e-06 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.768874+0000", 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017768009999999999 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.768996+0000", 2024-04-26T12:11:24.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012290099999999999 2024-04-26T12:11:24.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769110+0000", 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011340000000000001 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.806 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182289 5.b 5:da4a3a3a:::benchmark_data_smithi045_43640_object33915:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.806 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.767102+0000", 2024-04-26T12:11:24.806 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003246952, 2024-04-26T12:11:24.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035743429999999998, 2024-04-26T12:11:24.806 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.806 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.807 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.807 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.807 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.807 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182289 2024-04-26T12:11:24.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.807 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767102+0000", 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767102+0000", 2024-04-26T12:11:24.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767102+0000", 2024-04-26T12:11:24.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767104+0000", 2024-04-26T12:11:24.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4609999999999998e-06 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767111+0000", 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3380000000000001e-06 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767116+0000", 2024-04-26T12:11:24.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:11:24.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767866+0000", 2024-04-26T12:11:24.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00074978299999999996 2024-04-26T12:11:24.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767983+0000", 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011733199999999999 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.768097+0000", 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113467 2024-04-26T12:11:24.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769541+0000", 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014446769999999999 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182292 5.f 5:feb456d9:::benchmark_data_smithi045_43640_object33918:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.769090+0000", 2024-04-26T12:11:24.815 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0012591049999999999, 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016415220000000001, 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.816 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182292 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769090+0000", 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769090+0000", 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769089+0000", 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769094+0000", 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8899999999999998e-06 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769105+0000", 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0457e-05 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769114+0000", 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2399999999999996e-06 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769155+0000", 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1461999999999997e-05 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769237+0000", 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1796000000000001e-05 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.822 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:182273 5.b e44/17)", 2024-04-26T12:11:24.822 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.769861+0000", 2024-04-26T12:11:24.822 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00048789699999999999, 2024-04-26T12:11:24.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00090523000000000003, 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769861+0000", 2024-04-26T12:11:24.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769861+0000", 2024-04-26T12:11:24.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769861+0000", 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769863+0000", 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8980000000000001e-06 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769868+0000", 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.916e-06 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.769872+0000", 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9349999999999996e-06 2024-04-26T12:11:24.828 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182294 5.0 5:02601048:::benchmark_data_smithi045_43640_object33920:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.770097+0000", 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00025186799999999998, 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00069717200000000003, 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.829 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182294 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770097+0000", 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770097+0000", 2024-04-26T12:11:24.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770097+0000", 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770102+0000", 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7520000000000002e-06 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770114+0000", 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1668000000000001e-05 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770122+0000", 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0919999999999998e-06 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770501+0000", 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000379 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770601+0000", 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100276 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.770673+0000", 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1352000000000004e-05 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:182273 5.b 5:d595da00:::benchmark_data_smithi045_43640_object33899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T12:11:24.833 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:24.761894+0000", 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0084549599999999992, 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089486300000000008, 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 182273 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.761894+0000", 2024-04-26T12:11:24.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.761894+0000", 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.761894+0000", 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:24.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.761897+0000", 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7640000000000001e-06 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.761904+0000", 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.761910+0000", 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3059999999999997e-06 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.836 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764134+0000", 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002224859 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764242+0000", 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010719500000000001 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.764342+0000", 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100314 2024-04-26T12:11:24.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:24.767695+0000", 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033532800000000001 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 10 2024-04-26T12:11:24.838 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:24.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:24.843 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:24.840+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:24.941 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:24.940+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:25.019 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:25.019 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:25.019 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:25.019 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:25.020 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:25.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:25.081 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:25.079+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:25.143 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:25.142+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:11:25.222 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.750368536000003, 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.223 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.224 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:25.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:25.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.748753293, 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:25.232 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.233 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.234 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.234 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:25.234 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:25.234 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.234 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.234 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:25.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:25.236 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:25.237 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.746388998, 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.238 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.242 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.244 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:25.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:25.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.246 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.246 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.246 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:25.246 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:25.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:25.247 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.832337684999999, 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:25.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:25.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:25.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:25.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.254 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.737658105000001, 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.255 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:25.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:25.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.260 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:25.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:25.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:25.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:25.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:25.265 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.732450333999999, 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.267 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:25.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.729251376000001, 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.275 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:25.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:25.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:25.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.728999567999999, 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:25.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.292 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.726343530000001, 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:25.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:25.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:25.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:25.297 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.724836760999999, 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.298 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.722226308000003, 2024-04-26T12:11:25.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.306 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.308 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.875623649000001, 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.309 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:25.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:25.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:25.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:25.314 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.924164523999998, 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:25.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.172440713, 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.321 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:25.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:25.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:25.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.172332096, 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.171923552999999, 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.166468393000001, 2024-04-26T12:11:25.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.342 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 14.039748784, 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.343 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.433703055000001, 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.348 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:25.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:25.352 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 13.433543637, 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.353 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:25.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:25.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:25.357 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:25.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:25.360 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:25.357+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:25.459 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:25.458+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:25.557 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:25.557 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:25.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.557 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:184570 5.4 e45/17 5:2e377222:::benchmark_data_smithi045_43640_object36196:head v 45'11701, mlcod=45'11698)", 2024-04-26T12:11:25.557 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.551865+0000", 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0040439880000000001, 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0040705029999999996, 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551865+0000", 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551865+0000", 2024-04-26T12:11:25.558 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551865+0000", 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551868+0000", 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7709999999999998e-06 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.559 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551872+0000", 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6539999999999998e-06 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551876+0000", 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5619999999999999e-06 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551938+0000", 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1718999999999996e-05 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.560 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.551955+0000", 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7623999999999999e-05 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:184574 5.b e45/17 5:d22ea4e4:::benchmark_data_smithi045_43640_object36200:head v 45'11429, mlcod=45'11427)", 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.553934+0000", 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0019749619999999998, 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002069478, 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553934+0000", 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553934+0000", 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553934+0000", 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553939+0000", 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7289999999999997e-06 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553950+0000", 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0553999999999999e-05 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553957+0000", 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9519999999999997e-06 2024-04-26T12:11:25.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553986+0000", 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9227999999999999e-05 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.553997+0000", 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0978999999999999e-05 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.564 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:184571 5.4 e45/17 5:297475c9:::benchmark_data_smithi045_43640_object36197:head v 45'11702, mlcod=45'11699)", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.554037+0000", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001872362, 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020590370000000001, 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554037+0000", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554037+0000", 2024-04-26T12:11:25.565 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554036+0000", 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554041+0000", 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0259999999999998e-06 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.566 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554049+0000", 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1580000000000005e-06 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554055+0000", 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9170000000000003e-06 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554084+0000", 2024-04-26T12:11:25.567 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8711e-05 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.554101+0000", 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6838e-05 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:184576 5.c 5:3a92e210:::benchmark_data_smithi045_43640_object36202:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555128+0000", 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00078116299999999997, 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001013655, 2024-04-26T12:11:25.568 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 184576 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555128+0000", 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.569 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555128+0000", 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555127+0000", 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555133+0000", 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9719999999999997e-06 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.570 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555143+0000", 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555151+0000", 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2600000000000005e-06 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555265+0000", 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114292 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555405+0000", 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013988999999999999 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:184577 5.c 5.69b04a6c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555159+0000", 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00074971599999999999, 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010339220000000001, 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:25.572 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 184577 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555159+0000", 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555159+0000", 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555159+0000", 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555162+0000", 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0589999999999998e-06 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555169+0000", 2024-04-26T12:11:25.574 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8549999999999996e-06 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555174+0000", 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7450000000000001e-06 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:184578 5.2 5:4fdab519:::benchmark_data_smithi045_43640_object36204:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555181+0000", 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00072790599999999995, 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010446229999999999, 2024-04-26T12:11:25.575 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 184578 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555181+0000", 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.576 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555181+0000", 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555181+0000", 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555184+0000", 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.751e-06 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555190+0000", 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5560000000000004e-06 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555195+0000", 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3299999999999998e-06 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555230+0000", 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4480999999999997e-05 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.578 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555332+0000", 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010175000000000001 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:184581 5.1 5:864d0d51:::benchmark_data_smithi045_43640_object36207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555328+0000", 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000581515, 2024-04-26T12:11:25.579 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00093553099999999997, 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 184581 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555328+0000", 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555328+0000", 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555327+0000", 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555332+0000", 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555341+0000", 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6399999999999992e-06 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555349+0000", 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5959999999999998e-06 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555390+0000", 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1474000000000003e-05 2024-04-26T12:11:25.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555517+0000", 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012652200000000001 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:184579 5.e e45/17 5:7c7f925f:::benchmark_data_smithi045_43640_object36205:head v 45'11522, mlcod=45'11518)", 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555881+0000", 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 2.8025999999999999e-05, 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00041858900000000003, 2024-04-26T12:11:25.583 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555881+0000", 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555881+0000", 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.584 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555880+0000", 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555886+0000", 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8320000000000002e-06 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555895+0000", 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8729999999999996e-06 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.585 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555902+0000", 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6250000000000001e-06 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.556074+0000", 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017186799999999999 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.556091+0000", 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7924999999999999e-05 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.586 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:184580 5.8 e45/17 5:12c1ca8c:::benchmark_data_smithi045_43640_object36206:head v 45'11268, mlcod=45'11265)", 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555915+0000", 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999943, 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00042029600000000002, 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555915+0000", 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555915+0000", 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555914+0000", 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555918+0000", 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6969999999999999e-06 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555924+0000", 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1920000000000002e-06 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555929+0000", 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4970000000000003e-06 2024-04-26T12:11:25.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555994+0000", 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5399000000000002e-05 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.556015+0000", 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0883e-05 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:184573 5.4 e45/17)", 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:25.555936+0000", 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999733, 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00043028100000000002, 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555936+0000", 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555936+0000", 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555936+0000", 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555943+0000", 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7479999999999996e-06 2024-04-26T12:11:25.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555949+0000", 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2750000000000001e-06 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:25.555953+0000", 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.437e-06 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:25.593 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 10 2024-04-26T12:11:25.594 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:25.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:25.595 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:25.594+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:25.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:25.696 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:25.695+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:25.793 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:25.798 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:25.796+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:25.817 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:25.818 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:25.818 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:25.818 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:25.820 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:25.821 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:25.835 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:25.836 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:25.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:25.898 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:25.897+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:25.999 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:25.998+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:26.097 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:26.098 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:26.099 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:26.099+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:26.113 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:26.200 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:26.199+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:26.300 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:26.300 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:26.301 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:26.300+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:26.313 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:26.402 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:26.401+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:26.503 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:26.502+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:26.541 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:26.541 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:26.557 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:26.605 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:26.602+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:26.705 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:26.704+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:26.732 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:26.732 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:26.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:26.806 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:26.804+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:26.907 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:26.906+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:26.948 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:26.948 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:26.966 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:27.007 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.006+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.109 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.107+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.188 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:11:27.197 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:27.197 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:27.211 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.210+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:27.311 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.310+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.412 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.411+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.433 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:27.433 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:27.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:27.512 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:27.511+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:27.616 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.613+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.625 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:27.626 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:27.640 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:27.724 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.723+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.814 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:27.813+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:27.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:27.856 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:27.856 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:27.871 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:27.957 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:27.955+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:27.997 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:28.016 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:28.015+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:28.018 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:28.021 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:28.022 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:28.093 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:28.093 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:28.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:28.093 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.621877855000001, 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.094 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:28.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:28.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:28.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.620262611999998, 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:28.099 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:28.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:28.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:28.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.617898316999998, 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:28.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:28.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:28.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.703847003999996, 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.110 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.609167423999999, 2024-04-26T12:11:28.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:28.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:28.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:28.120 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.603959652999997, 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:28.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.126 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.600760694999998, 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.127 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:28.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.600508886999997, 2024-04-26T12:11:28.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.137 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.597852848999999, 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.138 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.596346080000004, 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:28.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.593735627000001, 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:28.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:28.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:28.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:28.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:28.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.747132967999999, 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.154 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:28.159 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.795673842999999, 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:28.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:28.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:28.164 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.043950032000001, 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:28.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:28.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:28.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:28.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:28.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.043841414999999, 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:28.170 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:28.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:28.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:28.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:28.175 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.043432872, 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:28.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:28.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:28.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.037977712, 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:28.183 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:28.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:28.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 16.911258103000002, 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 16.305212374, 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 16.305052956000001, 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:28.204 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:11:28.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:28.207 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:28.205+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:28.306 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:28.304+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:28.407 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:28.405+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:28.408 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:28.408 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:28.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.408 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192629 5.c 5:3b75bb3c:::benchmark_data_smithi045_43640_object44255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.398315+0000", 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0085016989999999997, 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085308869999999992, 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192629 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.398315+0000", 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.398315+0000", 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.398314+0000", 2024-04-26T12:11:28.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.398317+0000", 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5009999999999999e-06 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.398322+0000", 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3929999999999999e-06 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.398329+0000", 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7800000000000003e-06 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400279+0000", 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001949559 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400401+0000", 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012207099999999999 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.412 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192631 5.2 5:4d47de42:::benchmark_data_smithi045_43640_object44257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400225+0000", 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065915030000000003, 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066931109999999999, 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192631 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.413 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400225+0000", 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400225+0000", 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400224+0000", 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400230+0000", 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5559999999999998e-06 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400240+0000", 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.044e-05 2024-04-26T12:11:28.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400247+0000", 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5039999999999996e-06 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400291+0000", 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3365999999999998e-05 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400414+0000", 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012353200000000001 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192633 5.7 5:efb73760:::benchmark_data_smithi045_43640_object44259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400264+0000", 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065527600000000004, 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067040670000000002, 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.417 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192633 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400264+0000", 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400264+0000", 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400263+0000", 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400267+0000", 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3409999999999999e-06 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400274+0000", 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8469999999999996e-06 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400280+0000", 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400310+0000", 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9425e-05 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400435+0000", 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000124716 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192634 5.2 5:4e62c4da:::benchmark_data_smithi045_43640_object44260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400291+0000", 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065256469999999999, 2024-04-26T12:11:28.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0067491879999999997, 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192634 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400291+0000", 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400291+0000", 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400290+0000", 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400294+0000", 2024-04-26T12:11:28.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400300+0000", 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6200000000000001e-06 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400306+0000", 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.48e-06 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402315+0000", 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020090730000000001 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402434+0000", 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118968 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192636 5.2 5:4f363ddf:::benchmark_data_smithi045_43640_object44262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400526+0000", 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0062902740000000002, 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0065548840000000004, 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192636 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400526+0000", 2024-04-26T12:11:28.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400526+0000", 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400526+0000", 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400529+0000", 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9650000000000002e-06 2024-04-26T12:11:28.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400538+0000", 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7080000000000003e-06 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400545+0000", 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.404372+0000", 2024-04-26T12:11:28.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038275039999999998 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.404508+0000", 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013517999999999999 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192637 5.1 5:85f3c1fc:::benchmark_data_smithi045_43640_object44263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400551+0000", 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0062657060000000002, 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0065708249999999998, 2024-04-26T12:11:28.431 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192637 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400551+0000", 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400551+0000", 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400550+0000", 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400553+0000", 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.48e-06 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400559+0000", 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.156e-06 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400565+0000", 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.998e-06 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.401510+0000", 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00094474900000000004 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.401672+0000", 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016194500000000001 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192639 5.c 5:33b24f13:::benchmark_data_smithi045_43640_object44265:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400576+0000", 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0062400399999999996, 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0065829299999999999, 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192639 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400576+0000", 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400576+0000", 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400576+0000", 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400578+0000", 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1950000000000002e-06 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400584+0000", 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9889999999999997e-06 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400590+0000", 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3109999999999996e-06 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402402+0000", 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018121249999999999 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402496+0000", 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4299e-05 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.438 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192640 5.5 5:ac47c76c:::benchmark_data_smithi045_43640_object44266:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.400596+0000", 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0062206859999999996, 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0066037209999999999, 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192640 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.439 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400596+0000", 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400596+0000", 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400595+0000", 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400598+0000", 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.368e-06 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400604+0000", 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9789999999999998e-06 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400609+0000", 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2939999999999996e-06 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400653+0000", 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4143000000000001e-05 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.400792+0000", 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138975 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:192635 5.8 e46/17 5:157ea4f8:::benchmark_data_smithi045_43640_object44261:head v 46'11757, mlcod=46'11754)", 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.402177+0000", 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0046394729999999999, 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050660599999999998, 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402177+0000", 2024-04-26T12:11:28.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402177+0000", 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402176+0000", 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402183+0000", 2024-04-26T12:11:28.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402192+0000", 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.363e-06 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402200+0000", 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4399999999999999e-06 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402316+0000", 2024-04-26T12:11:28.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000116439 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402347+0000", 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0457999999999999e-05 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:192638 5.e e46/17 5:7718aff7:::benchmark_data_smithi045_43640_object44264:head v 46'12041, mlcod=46'12039)", 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.402211+0000", 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0046058180000000002, 2024-04-26T12:11:28.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050660080000000003, 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402211+0000", 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402211+0000", 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402210+0000", 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402214+0000", 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8229999999999997e-06 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402301+0000", 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6615999999999999e-05 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402306+0000", 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5419999999999996e-06 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402338+0000", 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1860999999999999e-05 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402357+0000", 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8698999999999998e-05 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.449 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192641 5.5 5:a18ee014:::benchmark_data_smithi045_43640_object44267:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.402812+0000", 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004004418, 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0044988010000000002, 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192641 2024-04-26T12:11:28.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402812+0000", 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402812+0000", 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402811+0000", 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402816+0000", 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3589999999999999e-06 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402826+0000", 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9830000000000008e-06 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402834+0000", 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.357e-06 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402871+0000", 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.748e-05 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402985+0000", 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114362 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192642 5.3 5:ccce4d50:::benchmark_data_smithi045_43640_object44268:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.402845+0000", 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003971774, 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045034920000000004, 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192642 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402845+0000", 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402845+0000", 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402844+0000", 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402847+0000", 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2800000000000002e-06 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402852+0000", 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8459999999999996e-06 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402857+0000", 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7339999999999999e-06 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403770+0000", 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00091326799999999996 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403880+0000", 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011001300000000001 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192644 5.c 5:3321bc09:::benchmark_data_smithi045_43640_object44270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.402872+0000", 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039444939999999998, 2024-04-26T12:11:28.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045130960000000003, 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192644 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402872+0000", 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402872+0000", 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402872+0000", 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402874+0000", 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402880+0000", 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2310000000000001e-06 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.402886+0000", 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2329999999999997e-06 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403760+0000", 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00087438800000000003 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403881+0000", 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120788 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:192645 5.b e46/17 5:d2dd1707:::benchmark_data_smithi045_43640_object44271:head v 46'11898, mlcod=46'11896)", 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.403280+0000", 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035361300000000002, 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041408560000000001, 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.461 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403280+0000", 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403280+0000", 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403280+0000", 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403285+0000", 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0819999999999998e-06 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403293+0000", 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9170000000000006e-06 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403298+0000", 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3229999999999997e-06 2024-04-26T12:11:28.463 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403593+0000", 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00029514599999999998 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.403611+0000", 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7187e-05 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.464 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:192646 5.7 5:e4f7fe34:::benchmark_data_smithi045_43640_object44272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.405009+0000", 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001807496, 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024491199999999999, 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 192646 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.465 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405009+0000", 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405009+0000", 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405008+0000", 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.466 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405014+0000", 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2709999999999998e-06 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405026+0000", 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2265e-05 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405035+0000", 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6559999999999998e-06 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.467 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405078+0000", 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2616e-05 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.405208+0000", 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013011699999999999 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:192647 5.0 e46/17 5:0fb065fe:::benchmark_data_smithi045_43640_object44273:head v 46'12105, mlcod=46'12103)", 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.406530+0000", 2024-04-26T12:11:28.468 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000286509, 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00096483400000000003, 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406530+0000", 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406530+0000", 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406529+0000", 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406535+0000", 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9270000000000002e-06 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406544+0000", 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6519999999999995e-06 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406550+0000", 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0909999999999998e-06 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406591+0000", 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0880000000000002e-05 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.406613+0000", 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2412000000000002e-05 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.472 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.472 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:28.472 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 16 2024-04-26T12:11:28.472 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:28.473 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:28.517 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:28.515+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:28.612 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:28.609+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:28.674 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:28.674 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:28.674 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:28.674 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:28.674 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:28.688 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:28.729 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:28.728+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:28.812 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:28.810+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:28.914 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:28.912+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:28.934 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 53.675523888000001, 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.935 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.949720618999997, 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.942 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:28.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:28.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.947 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.948 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.458531588, 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.949 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:28.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.456180212, 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.954 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:28.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:28.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.959 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.454537340999998, 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.960 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:28.961 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.443081929000002, 2024-04-26T12:11:28.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:28.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.439826951999997, 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:28.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.972 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.437329277000003, 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:28.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:28.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:28.977 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.436645976000001, 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:28.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:28.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.434525460000003, 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.432311448999997, 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:28.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.751811893999999, 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:28.991 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:28.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:28.996 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 21.660920073, 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:28.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:28.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:29.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144974 5.c 5:3ab50d54:::benchmark_data_smithi045_43640_object144973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.879924233000001, 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020753246999999999, 2024-04-26T12:11:29.001 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144974 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046574+0000", 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046674+0000", 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9868e-05 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046683+0000", 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046689+0000", 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2729999999999999e-06 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046767+0000", 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7288999999999998e-05 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.004 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046944+0000", 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017754700000000001 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067230+0000", 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020285184000000001 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067283+0000", 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3986000000000001e-05 2024-04-26T12:11:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067328+0000", 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4404999999999999e-05 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:29.006 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:29.007 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.878164663, 2024-04-26T12:11:29.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:29.007 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:29.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144971 5.4 e40/17 5:25843963:::benchmark_data_smithi045_43640_object144970:head v 40'9138, mlcod=40'9135)", 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.877919167999998, 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020798423, 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.012 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048579+0000", 2024-04-26T12:11:29.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048647+0000", 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7360000000000006e-05 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048655+0000", 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8970000000000008e-06 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048661+0000", 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062933+0000", 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014272093 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062953+0000", 2024-04-26T12:11:29.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0778e-05 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069352+0000", 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063989310000000001 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069378+0000", 2024-04-26T12:11:29.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5831999999999999e-05 2024-04-26T12:11:29.017 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.017 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.017 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.876386236999998, 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:29.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.873862042999999, 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:29.022 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:29.024 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.024 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.024 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.025 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.027 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8935935659999998, 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:29.028 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.029 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:29.031 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.032 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.039095700999999997, 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:29.033 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.034 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:29.036 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.037 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.038 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:29.038 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:29.038 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:29.038 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:29.038 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:29.038 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:29.039 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:29.041 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:29.042 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:29.039+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:29.144 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:29.140+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:29.218 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194911 5.d 5:bc1c09c7:::benchmark_data_smithi045_43640_object46537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216003+0000", 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.000654099, 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00067858100000000004, 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.219 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194911 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216003+0000", 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216003+0000", 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216002+0000", 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216006+0000", 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1489999999999996e-06 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.221 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216014+0000", 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8229999999999995e-06 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216019+0000", 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216052+0000", 2024-04-26T12:11:29.222 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2493999999999998e-05 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216165+0000", 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011338800000000001 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.223 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194912 5.9 5:9be3fac0:::benchmark_data_smithi045_43640_object46538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216026+0000", 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00063073899999999995, 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00073077500000000002, 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194912 2024-04-26T12:11:29.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216026+0000", 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216026+0000", 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.225 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216026+0000", 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216028+0000", 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2960000000000001e-06 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216034+0000", 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9710000000000001e-06 2024-04-26T12:11:29.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216039+0000", 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0490000000000003e-06 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.227 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216082+0000", 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3171999999999999e-05 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216159+0000", 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6141000000000002e-05 2024-04-26T12:11:29.228 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194913 5.d 5.84a9cbfd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216046+0000", 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00061057699999999995, 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00079224500000000002, 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.229 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194913 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216046+0000", 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216046+0000", 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.230 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216046+0000", 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216048+0000", 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2050000000000001e-06 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216054+0000", 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.694e-06 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216059+0000", 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.344e-06 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194914 5.0 5:0fb4dcbf:::benchmark_data_smithi045_43640_object46540:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216065+0000", 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00059229599999999997, 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00083074400000000001, 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.232 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194914 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216065+0000", 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216065+0000", 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216064+0000", 2024-04-26T12:11:29.234 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216067+0000", 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1890000000000001e-06 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216072+0000", 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216077+0000", 2024-04-26T12:11:29.235 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8330000000000001e-06 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216500+0000", 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00042273499999999998 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216606+0000", 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010665700000000001 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216715+0000", 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109184 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194915 5.e 5:7e59401f:::benchmark_data_smithi045_43640_object46541:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216081+0000", 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00057589299999999996, 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00088554599999999997, 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.237 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194915 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216081+0000", 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216081+0000", 2024-04-26T12:11:29.238 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216081+0000", 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216090+0000", 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.239 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216096+0000", 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2349999999999996e-06 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216101+0000", 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9439999999999996e-06 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216138+0000", 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6520000000000003e-05 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.240 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216258+0000", 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011996 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216364+0000", 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010627 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194916 5.9 5.5813fc59 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216111+0000", 2024-04-26T12:11:29.241 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00054639000000000001, 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00092321299999999999, 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194916 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216111+0000", 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216111+0000", 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216110+0000", 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216113+0000", 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3410000000000001e-06 2024-04-26T12:11:29.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216119+0000", 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2210000000000002e-06 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.244 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216124+0000", 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.95e-06 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194917 5.d 5.71e1974d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.216131+0000", 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00052595099999999998, 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00095366699999999995, 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.245 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194917 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216131+0000", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216131+0000", 2024-04-26T12:11:29.246 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216131+0000", 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216133+0000", 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.351e-06 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216139+0000", 2024-04-26T12:11:29.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9839999999999998e-06 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216144+0000", 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0259999999999998e-06 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194898 5.0 5:04f2decf:::benchmark_data_smithi045_43640_object46524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.211652+0000", 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0050053989999999998, 2024-04-26T12:11:29.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00548739, 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194898 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211652+0000", 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211652+0000", 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211651+0000", 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211656+0000", 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9370000000000003e-06 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211667+0000", 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0825999999999999e-05 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211674+0000", 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8120000000000008e-06 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211716+0000", 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1121000000000002e-05 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211835+0000", 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011924100000000001 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211938+0000", 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010316599999999999 2024-04-26T12:11:29.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216477+0000", 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045388169999999997 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194900 5.8 5:193feaf5:::benchmark_data_smithi045_43640_object46526:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.211754+0000", 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0049032360000000001, 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0054626750000000002, 2024-04-26T12:11:29.253 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194900 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211754+0000", 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211754+0000", 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211753+0000", 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211756+0000", 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.227e-06 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211760+0000", 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7570000000000004e-06 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211766+0000", 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6300000000000003e-06 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211808+0000", 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2148999999999999e-05 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211895+0000", 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7034999999999996e-05 2024-04-26T12:11:29.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.211957+0000", 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2014999999999995e-05 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216485+0000", 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045280820000000001 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194903 5.0 5:0df244aa:::benchmark_data_smithi045_43640_object46529:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.213023+0000", 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0036344110000000002, 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042688459999999998, 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194903 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213023+0000", 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213023+0000", 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213022+0000", 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213027+0000", 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213041+0000", 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3633e-05 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213050+0000", 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8140000000000007e-06 2024-04-26T12:11:29.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213808+0000", 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00075798 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213892+0000", 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4252999999999994e-05 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213956+0000", 2024-04-26T12:11:29.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3513e-05 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194904 5.b 5:dc5228d4:::benchmark_data_smithi045_43640_object46530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.213057+0000", 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0035998509999999998, 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043041879999999996, 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.263 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194904 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213057+0000", 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213057+0000", 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213057+0000", 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213060+0000", 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9000000000000002e-06 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213068+0000", 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0180000000000001e-06 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213074+0000", 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1519999999999997e-06 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213138+0000", 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3940000000000001e-05 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213267+0000", 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000128909 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213374+0000", 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010701600000000001 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.215017+0000", 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016429560000000001 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.267 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:194906 5.0 5:0a77254f:::benchmark_data_smithi045_43640_object46532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.213217+0000", 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0034402299999999999, 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042234919999999997, 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 194906 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213217+0000", 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213217+0000", 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213216+0000", 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213220+0000", 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4120000000000003e-06 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213230+0000", 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.213238+0000", 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4869999999999996e-06 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.215256+0000", 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002017774 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.215369+0000", 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113563 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.215432+0000", 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2626000000000007e-05 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:194898 5.0 e46/17 ondisk, result = 0)", 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:29.214875+0000", 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001781794, 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026347089999999998, 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.214875+0000", 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.214875+0000", 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.214875+0000", 2024-04-26T12:11:29.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.214877+0000", 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9489999999999999e-06 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.214882+0000", 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1769999999999997e-06 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.214886+0000", 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0350000000000003e-06 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216465+0000", 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0015787780000000001 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:29.216472+0000", 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6699999999999997e-06 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.275 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.276 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.276 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:29.276 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 13 2024-04-26T12:11:29.276 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:29.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-26T12:11:29.278 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:29.278 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:29.275+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:29.378 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:29.377+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:29.478 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:29.477+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:29.501 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:29.501 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:29.501 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:29.501 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:29.501 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:29.515 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:29.580 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:29.579+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:29.681 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:29.680+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:29.708 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:29.708 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:29.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.235927590999999, 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.710 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.710 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.710 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.710 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.710 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:29.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:29.713 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:29.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:29.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:29.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:29.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:29.720 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.234312348000003, 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.721 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:29.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:29.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.726 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.231948052999996, 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:29.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:29.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.733 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.317896740000002, 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.734 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.223217159999997, 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.740 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:29.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:29.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:29.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.218009389000002, 2024-04-26T12:11:29.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.746 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:29.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:29.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:29.751 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.214810430999997, 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:29.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.214558623000002, 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.757 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:29.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:29.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:29.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.762 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.211902584999997, 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:29.765 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:29.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.767 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.768 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.210395816000002, 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:29.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:29.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:29.774 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.207785362999999, 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:29.779 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 32.361182704000001, 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.780 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:29.785 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.409723579000001, 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:29.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:29.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.657999768, 2024-04-26T12:11:29.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:29.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.657891151000001, 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.797 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.802 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.657482607999999, 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:29.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:29.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:29.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.652027447999998, 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.808 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:29.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.813 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 18.525307839, 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:29.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:29.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:29.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:29.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.919262109999998, 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:29.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:29.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.825 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 17.919102691999999, 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:29.826 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.830 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.831 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:29.831 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:29.831 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:29.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:29.833 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:29.830+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:29.933 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:29.931+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:30.033 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:30.031+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.043 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:30.043 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:30.043 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.043 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197295 5.e e46/17 5:7ed8d6ae:::benchmark_data_smithi045_43640_object48921:head v 46'12349, mlcod=46'12347)", 2024-04-26T12:11:30.043 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.031685+0000", 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0092578060000000004, 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0092812520000000003, 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031685+0000", 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.044 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031685+0000", 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031684+0000", 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.045 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031690+0000", 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.857e-06 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031700+0000", 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7459999999999995e-06 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031706+0000", 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1530000000000002e-06 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031779+0000", 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2522999999999997e-05 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031802+0000", 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3192000000000001e-05 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.047 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:197299 5.6 5:6f3e3079:::benchmark_data_smithi045_43640_object48925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:30.048 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.031868+0000", 2024-04-26T12:11:30.048 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0090749809999999993, 2024-04-26T12:11:30.048 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0091690869999999994, 2024-04-26T12:11:30.048 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.048 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 197299 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031868+0000", 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.049 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031868+0000", 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031867+0000", 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031870+0000", 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031877+0000", 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9149999999999999e-06 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.031883+0000", 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6339999999999998e-06 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.033875+0000", 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019923319999999999 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.034023+0000", 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014817899999999999 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:197305 5.6 5:62ff33a1:::benchmark_data_smithi045_43640_object48931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:30.052 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.035058+0000", 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0058843109999999997, 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0060205939999999998, 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 197305 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.053 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035058+0000", 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035058+0000", 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.054 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035058+0000", 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035062+0000", 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7620000000000001e-06 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035068+0000", 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4189999999999999e-06 2024-04-26T12:11:30.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035073+0000", 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7400000000000004e-06 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.038070+0000", 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002996921 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.038184+0000", 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011432700000000001 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.057 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197304 5.e e46/17 5:742077b3:::benchmark_data_smithi045_43640_object48930:head v 46'12350, mlcod=46'12347)", 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.035762+0000", 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0051805280000000002, 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053550919999999997, 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035762+0000", 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.058 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035762+0000", 2024-04-26T12:11:30.059 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.059 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.059 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035762+0000", 2024-04-26T12:11:30.059 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035767+0000", 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6239999999999999e-06 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035775+0000", 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4440000000000002e-06 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.060 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035781+0000", 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0449999999999997e-06 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.036095+0000", 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000314569 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.036115+0000", 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9360000000000001e-05 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.061 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197303 5.8 e46/17 5:1c7287aa:::benchmark_data_smithi045_43640_object48929:head v 46'12027, mlcod=46'12024)", 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.035787+0000", 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0051562079999999998, 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053665659999999997, 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.062 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035787+0000", 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035787+0000", 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035786+0000", 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.063 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035790+0000", 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3179999999999998e-06 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035795+0000", 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5770000000000001e-06 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035800+0000", 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4460000000000003e-06 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.064 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035826+0000", 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5928999999999999e-05 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035838+0000", 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2668e-05 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197307 5.0 e46/17 5:0d85f134:::benchmark_data_smithi045_43640_object48933:head v 46'12407, mlcod=46'12405)", 2024-04-26T12:11:30.065 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.035808+0000", 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.005134591, 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0053782120000000003, 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035808+0000", 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.066 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035808+0000", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035808+0000", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035815+0000", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035820+0000", 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8429999999999998e-06 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.035825+0000", 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5249999999999999e-06 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.036698+0000", 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00087278300000000002 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.036709+0000", 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1581e-05 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.069 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:197309 5.7 5:ede98037:::benchmark_data_smithi045_43640_object48935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.037503+0000", 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003440027, 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0037176890000000001, 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 197309 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.070 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037503+0000", 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037503+0000", 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037502+0000", 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037507+0000", 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037516+0000", 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2089999999999994e-06 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037523+0000", 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0779999999999998e-06 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.038303+0000", 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00077919899999999995 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.038413+0000", 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110461 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.073 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197310 5.0 e46/17 5:0f6e153d:::benchmark_data_smithi045_43640_object48936:head v 46'12408, mlcod=46'12405)", 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.037783+0000", 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031592590000000002, 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0034736430000000002, 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.074 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037783+0000", 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037783+0000", 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.075 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037783+0000", 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037788+0000", 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4960000000000004e-06 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037799+0000", 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0538e-05 2024-04-26T12:11:30.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.037805+0000", 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7150000000000003e-06 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039363+0000", 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0015584150000000001 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039377+0000", 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3805000000000001e-05 2024-04-26T12:11:30.077 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197314 5.0 e46/17 5:019d9ab4:::benchmark_data_smithi045_43640_object48940:head v 46'12409, mlcod=46'12405)", 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.039309+0000", 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001634234, 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002004184, 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.078 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039309+0000", 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039309+0000", 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039308+0000", 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039313+0000", 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2979999999999999e-06 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039323+0000", 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9660000000000008e-06 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039329+0000", 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3110000000000002e-06 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040798+0000", 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014684489999999999 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040810+0000", 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2126e-05 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.081 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197315 5.e e46/17 5:76e431b9:::benchmark_data_smithi045_43640_object48941:head v 46'12351, mlcod=46'12347)", 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.039498+0000", 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0014448180000000001, 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018802300000000001, 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.082 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039498+0000", 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039498+0000", 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039497+0000", 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.083 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039502+0000", 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8940000000000001e-06 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039512+0000", 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2930000000000006e-06 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039517+0000", 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6470000000000003e-06 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039777+0000", 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00025925399999999999 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.039794+0000", 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7941999999999999e-05 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:197318 5.1 5:82fd7f8a:::benchmark_data_smithi045_43640_object48944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.040370+0000", 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00057286100000000003, 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010801599999999999, 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 197318 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.086 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040370+0000", 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040370+0000", 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040369+0000", 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040373+0000", 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6140000000000002e-06 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040383+0000", 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5619999999999993e-06 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040390+0000", 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2559999999999996e-06 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040429+0000", 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8444e-05 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040521+0000", 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2589000000000004e-05 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197316 5.0 e46/17)", 2024-04-26T12:11:30.089 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.040566+0000", 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00037672999999999998, 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00095793199999999999, 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040566+0000", 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040566+0000", 2024-04-26T12:11:30.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040565+0000", 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040571+0000", 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3580000000000002e-06 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040579+0000", 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.040585+0000", 2024-04-26T12:11:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.066e-06 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:197319 5.e e46/17 5:713ebe00:::benchmark_data_smithi045_43640_object48945:head v 46'12352, mlcod=46'12347)", 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:30.041349+0000", 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9995933, 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00022208199999999999, 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:30.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041349+0000", 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041349+0000", 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041349+0000", 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041355+0000", 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9560000000000002e-06 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041364+0000", 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.132e-06 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041370+0000", 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9680000000000003e-06 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041403+0000", 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3413e-05 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:30.041420+0000", 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7147e-05 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:11:30.096 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:30.098 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:30.135 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:30.133+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.198 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:30.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:11:30.226 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:30.227 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:30.227 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:30.227 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:30.229 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:30.230 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:30.236 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:30.234+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.294 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:30.295 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:30.311 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:30.336 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:30.334+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.437 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:30.435+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.508 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:30.508 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:30.523 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:30.572 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:30.568+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:30.638 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:30.637+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:30.701 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:30.701 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:30.716 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:30.740 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:30.739+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:30.842 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:30.841+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:30.942 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:30.941+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:30.946 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:30.947 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:30.961 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:31.044 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:31.043+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:31.140 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:31.140 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:31.147 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:31.146+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:31.152 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:11:31.245 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:31.243+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:31.348 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:31.347+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:31.349 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:31.350 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:31.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:31.448 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:31.446+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:31.549 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:31.547+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:31.613 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:31.613 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:31.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:31.650 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:31.648+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:31.753 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:31.752+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:31.826 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:31.826 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:31.839 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:31.881 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:31.880+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:31.952 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:31.951+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:32.028 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:32.028 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:32.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:32.089 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:32.087+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:32.154 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:32.153+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:32.229 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:32.229 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:32.230 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:32.242 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:32.255 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:32.254+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:32.357 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:32.355+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:32.404 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:32.426 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:32.429 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:32.429 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:32.459 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:32.458+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:32.461 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:32.461 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:32.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:32.461 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 46.990094544000002, 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.462 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:32.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:32.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:32.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 46.988479300999998, 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.468 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:32.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:32.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 46.986115005999999, 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.474 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:32.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.072063692999997, 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:32.481 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:32.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:32.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.977384112999999, 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:32.486 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:32.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:32.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:32.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:32.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:32.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:32.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:32.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:32.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:32.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:32.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:32.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:32.495 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.495 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.496 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.496 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.496 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:32.496 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.972176341999997, 2024-04-26T12:11:32.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:32.497 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.497 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.497 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.497 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.497 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.498 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:32.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.498 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:32.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:32.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:32.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:32.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:32.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:32.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:32.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:32.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.968977383999999, 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.507 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.508 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:32.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.508 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:32.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.510 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:32.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:32.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:32.514 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.515 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.515 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.515 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.968725575999997, 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:32.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:32.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:32.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.966069537999999, 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:32.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:32.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:32.528 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.964562768999997, 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:32.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:32.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:32.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 42.961952316000001, 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.534 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:32.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:32.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.115349657000003, 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:32.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:32.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:32.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.163890532, 2024-04-26T12:11:32.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:32.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:32.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:32.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.412166720999998, 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.551 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.412058104, 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:32.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:32.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.411649561000001, 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:32.562 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.567 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.406194401, 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:32.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:32.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 21.279474791999998, 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:32.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:32.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.579 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 20.673429063, 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:32.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:32.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 20.673269645000001, 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:32.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:32.589 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:32.591 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:32.591 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:32.588+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:32.692 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:32.690+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:32.792 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:32.790+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205138 5.c 5:308372a9:::benchmark_data_smithi045_43640_object56764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.790606+0000", 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00034874199999999998, 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00037434700000000003, 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.793 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205138 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790606+0000", 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790606+0000", 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790605+0000", 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790609+0000", 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7500000000000001e-06 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790617+0000", 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6430000000000001e-06 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790624+0000", 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6259999999999997e-06 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790674+0000", 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0189999999999999e-05 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790813+0000", 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138689 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:205137 5.4 e47/17)", 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.790854+0000", 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000100004, 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000203387, 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790854+0000", 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790854+0000", 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790854+0000", 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790859+0000", 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4999999999999999e-06 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790868+0000", 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5539999999999998e-06 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790874+0000", 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:11:32.799 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205139 5.6 5.6f6c72e6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.790978+0000", 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999762, 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000134552, 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205139 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.800 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790978+0000", 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790978+0000", 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790978+0000", 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790981+0000", 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9019999999999999e-06 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790987+0000", 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790991+0000", 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7380000000000002e-06 2024-04-26T12:11:32.802 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:205123 5.8 e47/17 5:1f7a3068:::benchmark_data_smithi045_43640_object56749:head v 47'12493, mlcod=47'12491)", 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.786293+0000", 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004661536, 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048780259999999997, 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786293+0000", 2024-04-26T12:11:32.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786293+0000", 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786292+0000", 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786297+0000", 2024-04-26T12:11:32.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786305+0000", 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5440000000000001e-06 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786310+0000", 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8779999999999997e-06 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787751+0000", 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001441463 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787770+0000", 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9049999999999999e-05 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.806 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205125 5.c 5:355a8ec2:::benchmark_data_smithi045_43640_object56751:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.786443+0000", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0045112479999999998, 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0047903390000000002, 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205125 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786443+0000", 2024-04-26T12:11:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786443+0000", 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786442+0000", 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786446+0000", 2024-04-26T12:11:32.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1760000000000003e-06 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786456+0000", 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1079999999999999e-06 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786462+0000", 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786505+0000", 2024-04-26T12:11:32.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2648000000000002e-05 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786609+0000", 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104159 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205126 5.a 5:58e291a9:::benchmark_data_smithi045_43640_object56752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.786550+0000", 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0044044490000000004, 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0047506800000000002, 2024-04-26T12:11:32.810 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205126 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786550+0000", 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786550+0000", 2024-04-26T12:11:32.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786549+0000", 2024-04-26T12:11:32.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786554+0000", 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6269999999999999e-06 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786562+0000", 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5499999999999995e-06 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786569+0000", 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0090000000000001e-06 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786776+0000", 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000207004 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.786885+0000", 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108798 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787196+0000", 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00031123099999999998 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790817+0000", 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0036204459999999998 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.817 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205129 5.c 5:3257638b:::benchmark_data_smithi045_43640_object56755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.787123+0000", 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0038316439999999999, 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042666639999999999, 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205129 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.818 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787123+0000", 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787123+0000", 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787122+0000", 2024-04-26T12:11:32.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787126+0000", 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1010000000000002e-06 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787135+0000", 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9020000000000005e-06 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.787141+0000", 2024-04-26T12:11:32.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.19e-06 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788526+0000", 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013852630000000001 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788640+0000", 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113608 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205132 5.1 5:82c92633:::benchmark_data_smithi045_43640_object56758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.788115+0000", 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0028388060000000001, 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033426829999999999, 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205132 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788115+0000", 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788115+0000", 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788115+0000", 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788120+0000", 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3890000000000004e-06 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788129+0000", 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2779999999999999e-06 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788137+0000", 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2459999999999997e-06 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788183+0000", 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6594999999999997e-05 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788298+0000", 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011452599999999999 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:205130 5.0 e47/17 5:0b9a1b67:::benchmark_data_smithi045_43640_object56756:head v 47'12857, mlcod=47'12854)", 2024-04-26T12:11:32.825 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.788517+0000", 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0024375220000000001, 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003010057, 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788517+0000", 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788517+0000", 2024-04-26T12:11:32.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788516+0000", 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788523+0000", 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5250000000000002e-06 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788531+0000", 2024-04-26T12:11:32.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6170000000000007e-06 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788537+0000", 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9510000000000003e-06 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.789776+0000", 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001238489 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.789792+0000", 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6626999999999999e-05 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:205131 5.4 e47/17 5:26282db8:::benchmark_data_smithi045_43640_object56757:head v 47'12959, mlcod=47'12957)", 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.788546+0000", 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0024079349999999999, 2024-04-26T12:11:32.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030499139999999999, 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788546+0000", 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788546+0000", 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788546+0000", 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788549+0000", 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.162e-06 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788555+0000", 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3809999999999998e-06 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788559+0000", 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9469999999999996e-06 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788613+0000", 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4469000000000003e-05 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.788631+0000", 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7683e-05 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:205135 5.1 5:8e8b7a69:::benchmark_data_smithi045_43640_object56761:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.790393+0000", 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000561511, 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012686799999999999, 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 205135 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790393+0000", 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790393+0000", 2024-04-26T12:11:32.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790392+0000", 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790397+0000", 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4129999999999997e-06 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790406+0000", 2024-04-26T12:11:32.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790412+0000", 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4859999999999997e-06 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790457+0000", 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5890000000000003e-05 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790593+0000", 2024-04-26T12:11:32.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013547900000000001 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:205136 5.0 e47/17 5:01510785:::benchmark_data_smithi045_43640_object56762:head v 47'12858, mlcod=47'12854)", 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:32.790452+0000", 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00050264400000000001, 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0012826389999999999, 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:32.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790452+0000", 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790452+0000", 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790451+0000", 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790455+0000", 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8139999999999998e-06 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790461+0000", 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8669999999999999e-06 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.790465+0000", 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.357e-06 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.791570+0000", 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011051699999999999 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:32.791587+0000", 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6962000000000001e-05 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:32.840 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 12 2024-04-26T12:11:32.841 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:32.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:32.893 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:32.891+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:32.993 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:32.991+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:33.080 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:33.080 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:33.080 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:33.080 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:33.080 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:33.094 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:33.094+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:33.096 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:33.195 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:33.194+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:33.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:11:33.299 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:33.296+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:33.348 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:33.348 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:33.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:33.348 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:33.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.348 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 58.094277279000003, 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:33.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:33.354 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 53.36847401, 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:33.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:33.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:33.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:33.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:33.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:33.360 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.360 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 47.877284979000002, 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.361 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:33.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 47.874933603000002, 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:33.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:33.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:33.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 47.873290732000001, 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:33.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.861835319999997, 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:33.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:33.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:33.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:33.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:33.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.858580343, 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.383 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.387 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.856082667999999, 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:33.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.392 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.855399366999997, 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:33.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.853278850999999, 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.397 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:33.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:33.401 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.851064839999999, 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.405 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 36.170565285000002, 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:33.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:33.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.079673463999999, 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.412 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:33.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:144974 5.c 5:3ab50d54:::benchmark_data_smithi045_43640_object144973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.298677624, 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020753246999999999, 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 144974 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046575+0000", 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046574+0000", 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046674+0000", 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9868e-05 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046683+0000", 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046689+0000", 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2729999999999999e-06 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046767+0000", 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7288999999999998e-05 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.046944+0000", 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017754700000000001 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067230+0000", 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020285184000000001 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067283+0000", 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3986000000000001e-05 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067328+0000", 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4404999999999999e-05 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:33.420 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.296918053999999, 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:33.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:33.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144971 5.4 e40/17 5:25843963:::benchmark_data_smithi045_43640_object144970:head v 40'9138, mlcod=40'9135)", 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.296672559000001, 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020798423, 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048580+0000", 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048579+0000", 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048647+0000", 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7360000000000006e-05 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048655+0000", 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8970000000000008e-06 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048661+0000", 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062933+0000", 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014272093 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.062953+0000", 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0778e-05 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069352+0000", 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0063989310000000001 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069378+0000", 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5831999999999999e-05 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.295139628000001, 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:33.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.292615433999998, 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.433 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.312346957000001, 2024-04-26T12:11:33.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:33.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:33.442 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.457849092, 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:33.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:33.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:33.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:33.447 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:33.448 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:33.446+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:33.449 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:33.550 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:33.548+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207526 5.8 5:19940cbf:::benchmark_data_smithi045_43640_object59152:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.625406+0000", 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0067221169999999997, 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067468069999999996, 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207526 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625406+0000", 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625406+0000", 2024-04-26T12:11:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625406+0000", 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625408+0000", 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0870000000000001e-06 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625414+0000", 2024-04-26T12:11:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.818e-06 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625420+0000", 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9710000000000001e-06 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627367+0000", 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019466900000000001 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627489+0000", 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012252000000000001 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627604+0000", 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011481600000000001 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631459+0000", 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0038551789999999998 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207529 5.4 5:21685e47:::benchmark_data_smithi045_43640_object59155:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.626098+0000", 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0060300889999999998, 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061513009999999996, 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207529 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626098+0000", 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626098+0000", 2024-04-26T12:11:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626098+0000", 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626103+0000", 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626114+0000", 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1012999999999999e-05 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626122+0000", 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7060000000000004e-06 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627806+0000", 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016839330000000001 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627930+0000", 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000124315 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.628038+0000", 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010801700000000001 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631347+0000", 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00330854 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207531 5.4 5:20c4a86d:::benchmark_data_smithi045_43640_object59157:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.626613+0000", 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0055157879999999998, 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0057206089999999998, 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207531 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626613+0000", 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626613+0000", 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626612+0000", 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626616+0000", 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2830000000000003e-06 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626626+0000", 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4290000000000007e-06 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.626633+0000", 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2089999999999999e-06 2024-04-26T12:11:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629328+0000", 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026953379999999998 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629434+0000", 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010572400000000001 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629513+0000", 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9457999999999997e-05 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631394+0000", 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001880271 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207532 5.8 5:15d60284:::benchmark_data_smithi045_43640_object59158:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.627412+0000", 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0047165669999999996, 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0050021839999999998, 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207532 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627412+0000", 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627412+0000", 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627411+0000", 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627416+0000", 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4100000000000001e-06 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627422+0000", 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4289999999999998e-06 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627427+0000", 2024-04-26T12:11:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7480000000000001e-06 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629528+0000", 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021006179999999998 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629636+0000", 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000108711 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629745+0000", 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010840600000000001 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207535 5.0 5:000e5560:::benchmark_data_smithi045_43640_object59161:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.627937+0000", 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.004191485, 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.004551121, 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207535 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627937+0000", 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627937+0000", 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627936+0000", 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627941+0000", 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3839999999999999e-06 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627948+0000", 2024-04-26T12:11:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.627953+0000", 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631411+0000", 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034584099999999999 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631523+0000", 2024-04-26T12:11:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111592 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631634+0000", 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111354 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207536 5.8 5:1a7a63b1:::benchmark_data_smithi045_43640_object59162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.629644+0000", 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0024845710000000001, 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029213640000000001, 2024-04-26T12:11:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207536 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629644+0000", 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629644+0000", 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629643+0000", 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629649+0000", 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4779999999999999e-06 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629666+0000", 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7159999999999998e-05 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.629673+0000", 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5079999999999999e-06 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631482+0000", 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001809141 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631589+0000", 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106628 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631702+0000", 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113102 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:207532 5.8 e47/17)", 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00053808800000000004, 2024-04-26T12:11:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010485690000000001, 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631594+0000", 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0879999999999997e-06 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631602+0000", 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.32e-06 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631608+0000", 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207543 5.0 5.badb4a40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00053882699999999997, 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0010994679999999999, 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207543 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631590+0000", 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631589+0000", 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631594+0000", 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2299999999999999e-06 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631605+0000", 2024-04-26T12:11:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0516999999999999e-05 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631613+0000", 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0010000000000001e-06 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207544 5.b 5:da5642d9:::benchmark_data_smithi045_43640_object59170:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.631620+0000", 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00050829100000000002, 2024-04-26T12:11:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001126862, 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207544 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631620+0000", 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631620+0000", 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631620+0000", 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631623+0000", 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7999999999999999e-06 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631630+0000", 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9779999999999999e-06 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631639+0000", 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0589999999999992e-06 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631677+0000", 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631792+0000", 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011428400000000001 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631903+0000", 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111426 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207545 5.4 5:21736e5d:::benchmark_data_smithi045_43640_object59171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.632435+0000", 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9996939, 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00039213600000000001, 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207545 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632435+0000", 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632435+0000", 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632434+0000", 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632438+0000", 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1559999999999997e-06 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632447+0000", 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0450000000000006e-06 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632453+0000", 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9340000000000003e-06 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632492+0000", 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8767999999999999e-05 2024-04-26T12:11:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632613+0000", 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000121204 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.632723+0000", 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110184 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:207523 5.8 5:1effc57c:::benchmark_data_smithi045_43640_object59149:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:33.625285+0000", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0068433469999999996, 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0076217339999999998, 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 207523 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625285+0000", 2024-04-26T12:11:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625285+0000", 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625284+0000", 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625289+0000", 2024-04-26T12:11:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5260000000000004e-06 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625299+0000", 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0078000000000001e-05 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625305+0000", 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4439999999999996e-06 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625329+0000", 2024-04-26T12:11:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3402000000000001e-05 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625400+0000", 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0784000000000005e-05 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.625479+0000", 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9807000000000003e-05 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:33.631429+0000", 2024-04-26T12:11:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0059496319999999998 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 11 2024-04-26T12:11:33.680 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:33.681 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:33.680+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:33.682 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:33.784 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:33.781+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:33.883 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:33.882+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:33.891 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:33.891 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:33.905 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:33.984 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:33.983+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:34.085 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:34.084+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:34.094 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.622975001, 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.621359757999997, 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.618995462999997, 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.704944150000003, 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.610264569999998, 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.605056799000003, 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.601857840999998, 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.601606033000003, 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.598949994999998, 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.597443226000003, 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.594832773, 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.748230114000002, 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.796770988999999, 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 23.045047178000001, 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 23.044938560999999, 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 23.044530018, 2024-04-26T12:11:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 23.039074857999999, 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.912355249000001, 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.306309519999999, 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 22.306150102, 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:34.214 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:11:34.217 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:34.217 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:34.213+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:34.316 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:34.315+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:34.417 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:34.415+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209806 5.c 5:39002cc9:::benchmark_data_smithi045_43640_object61432:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.412370+0000", 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0082164089999999992, 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0082423840000000002, 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.422 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209806 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.412370+0000", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.412370+0000", 2024-04-26T12:11:34.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.412369+0000", 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.412373+0000", 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3170000000000003e-06 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.412380+0000", 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1570000000000003e-06 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.412386+0000", 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0329999999999999e-06 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415017+0000", 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026317789999999999 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415146+0000", 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000128529 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:209810 5.b e48/17 5:d6a6ac25:::benchmark_data_smithi045_43640_object61436:head v 48'12939, mlcod=48'12936)", 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.414747+0000", 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0058389230000000002, 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059503079999999996, 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.426 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414747+0000", 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414747+0000", 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414747+0000", 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414752+0000", 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6869999999999999e-06 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414763+0000", 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0463e-05 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414769+0000", 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3389999999999998e-06 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414940+0000", 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017062300000000001 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414960+0000", 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0254999999999998e-05 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.429 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209809 5.1 5:89a7907a:::benchmark_data_smithi045_43640_object61435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.414986+0000", 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0056004540000000004, 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057923000000000002, 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209809 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414986+0000", 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414986+0000", 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414985+0000", 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414989+0000", 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0659999999999997e-06 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.414997+0000", 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5029999999999997e-06 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415005+0000", 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8879999999999997e-06 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415090+0000", 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4217999999999999e-05 2024-04-26T12:11:34.433 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415202+0000", 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000112188 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209811 5.c 5:3ee59f0a:::benchmark_data_smithi045_43640_object61437:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.415016+0000", 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0055699879999999997, 2024-04-26T12:11:34.434 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0058525280000000001, 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209811 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415016+0000", 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.435 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415016+0000", 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415016+0000", 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415018+0000", 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5749999999999999e-06 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.436 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415026+0000", 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4189999999999996e-06 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.415031+0000", 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5600000000000001e-06 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417158+0000", 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021264470000000001 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.437 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417253+0000", 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5390999999999995e-05 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209821 5.5 5:a02e313f:::benchmark_data_smithi045_43640_object61447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.417426+0000", 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031598120000000001, 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035164570000000002, 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.438 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209821 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417426+0000", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417426+0000", 2024-04-26T12:11:34.439 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417426+0000", 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417430+0000", 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9489999999999998e-06 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417440+0000", 2024-04-26T12:11:34.440 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0356e-05 2024-04-26T12:11:34.441 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.441 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.441 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.441 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417446+0000", 2024-04-26T12:11:34.441 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417486+0000", 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9755999999999997e-05 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417614+0000", 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000128298 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209822 5.c 5:39b56032:::benchmark_data_smithi045_43640_object61448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.417460+0000", 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003126331, 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035573110000000001, 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209822 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.443 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417460+0000", 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417460+0000", 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.444 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417459+0000", 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417462+0000", 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.227e-06 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417466+0000", 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4209999999999997e-06 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.445 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417469+0000", 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3610000000000001e-06 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.418971+0000", 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001501336 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.446 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419066+0000", 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5147000000000002e-05 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209823 5.5 5:a2969382:::benchmark_data_smithi045_43640_object61449:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.417474+0000", 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0031119210000000001, 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003638835, 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.447 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209823 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417474+0000", 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417474+0000", 2024-04-26T12:11:34.448 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417474+0000", 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417476+0000", 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0999999999999998e-06 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417482+0000", 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0730000000000001e-06 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417487+0000", 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8899999999999998e-06 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419243+0000", 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001756531 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.450 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419370+0000", 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000126315 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:209814 5.4 e48/17 5:216a4718:::benchmark_data_smithi045_43640_object61440:head v 48'13246, mlcod=48'13243)", 2024-04-26T12:11:34.451 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.417614+0000", 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0029726290000000001, 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003553386, 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417614+0000", 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417614+0000", 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417613+0000", 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417617+0000", 2024-04-26T12:11:34.453 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4180000000000001e-06 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417621+0000", 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.417624+0000", 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2629999999999999e-06 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.454 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.418957+0000", 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001333332 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.418975+0000", 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7725999999999999e-05 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:209824 5.c 5:3c55d372:::benchmark_data_smithi045_43640_object61450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.419500+0000", 2024-04-26T12:11:34.455 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0010858549999999999, 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001704066, 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 209824 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419500+0000", 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.456 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419500+0000", 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419499+0000", 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419505+0000", 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1259999999999997e-06 2024-04-26T12:11:34.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419514+0000", 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6299999999999993e-06 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.419521+0000", 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420202+0000", 2024-04-26T12:11:34.458 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00068066899999999996 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420287+0000", 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5259000000000005e-05 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:209818 5.4 e48/17 5:2b400c3a:::benchmark_data_smithi045_43640_object61444:head v 48'13247, mlcod=48'13244)", 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:34.420187+0000", 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00039924600000000002, 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010617560000000001, 2024-04-26T12:11:34.459 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420187+0000", 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420187+0000", 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:34.460 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420186+0000", 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420193+0000", 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0900000000000001e-06 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420201+0000", 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3499999999999997e-06 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:34.461 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420206+0000", 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0560000000000004e-06 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420634+0000", 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00042796199999999999 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:34.420670+0000", 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6409000000000003e-05 2024-04-26T12:11:34.462 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.463 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:34.463 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.463 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:34.463 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:34.463 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 10 2024-04-26T12:11:34.463 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:34.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:34.464 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:34.549 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:34.548+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:34.619 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:34.617+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:34.660 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:34.661 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:34.708 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:34.708 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:34.721 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:34.719+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:34.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:34.821 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:34.819+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:34.922 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:34.920+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:34.966 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:34.966 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:34.983 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:35.028 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:35.026+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:35.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-04-26T12:11:35.124 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:35.123+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:35.168 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:35.168 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:35.183 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:35.224 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:35.222+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:35.325 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:35.323+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:35.406 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:35.406 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:35.420 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:35.426 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:35.425+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:35.528 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:35.526+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:35.628 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:35.626+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:35.635 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:35.635 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:35.648 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:35.731 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:35.729+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:35.831 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:35.829+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:35.846 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:35.846 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:35.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:35.943 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:35.942+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:36.033 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:36.032+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:36.097 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:36.097 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:36.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:36.134 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:36.132+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:36.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:11:36.247 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:36.235+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:36.339 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:36.338+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:36.355 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:36.355 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:36.367 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:36.438 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:36.436+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:36.538 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:36.536+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:36.549 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:36.549 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:36.564 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:36.648 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:36.646+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:36.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:36.740 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:36.738+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:36.788 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:36.789 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:36.804 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:36.831 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:36.842 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:36.841+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:36.852 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:36.852 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:36.853 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:36.853 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:36.855 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:36.855 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:36.942 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:36.940+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.557504522999999, 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:37.029 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.032 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:37.033 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.035 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.555889280000002, 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:37.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:37.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:37.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:37.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:37.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.553524985000003, 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:37.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:37.046 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.639473672000001, 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:37.051 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.544794091999997, 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:37.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:37.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.539586321000002, 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:37.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:37.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:37.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:37.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.536387363000003, 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.063 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.068 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.536135555000001, 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:37.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:37.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:37.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:37.073 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.533479517000004, 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.074 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.531972748000001, 2024-04-26T12:11:37.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:37.084 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 47.529362294999999, 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:37.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:37.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:37.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:37.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:37.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.682759636, 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:37.090 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.095 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.731300511000001, 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:37.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:37.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.979576699999999, 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.101 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:37.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.979468083, 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.107 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.112 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.979059540000002, 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.973604380000001, 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:37.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:37.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.124 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.846884770999999, 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:37.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:37.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:37.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:37.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.240839042000001, 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.130 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:37.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:37.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 25.240679623999998, 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:37.135 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.139 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.140 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.140 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:37.140 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:37.140 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:37.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:37.142 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:37.139+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:11:37.242 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:37.240+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:37.342 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:37.341+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:37.344 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218154 5.7 5:e45c63ad:::benchmark_data_smithi045_43640_object69780:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.336282+0000", 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065112069999999998, 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006542544, 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.345 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218154 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336282+0000", 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336282+0000", 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336281+0000", 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336285+0000", 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8240000000000001e-06 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336294+0000", 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7369999999999995e-06 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336301+0000", 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336344+0000", 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3914e-05 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.336481+0000", 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013650199999999999 2024-04-26T12:11:37.348 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218155 5.7 5:e219a05d:::benchmark_data_smithi045_43640_object69781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.338005+0000", 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0047878460000000001, 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048968980000000002, 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218155 2024-04-26T12:11:37.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338005+0000", 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338005+0000", 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338005+0000", 2024-04-26T12:11:37.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338009+0000", 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3159999999999998e-06 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338017+0000", 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4579999999999993e-06 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338023+0000", 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3329999999999996e-06 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338479+0000", 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000456002 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338618+0000", 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013908 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218156 5.a 5:5fc2a531:::benchmark_data_smithi045_43640_object69782:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.338031+0000", 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0047619029999999996, 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049406959999999996, 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218156 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338031+0000", 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338031+0000", 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338031+0000", 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338033+0000", 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.891e-06 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338038+0000", 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8400000000000002e-06 2024-04-26T12:11:37.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.338041+0000", 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.129e-06 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340095+0000", 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020537659999999998 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340226+0000", 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013087400000000001 2024-04-26T12:11:37.356 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340343+0000", 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011709600000000001 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:218158 5.e e49/17 5:7a94fdd2:::benchmark_data_smithi045_43640_object69784:head v 49'13688, mlcod=49'13686)", 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.339463+0000", 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0033299499999999999, 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035846459999999999, 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.357 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339463+0000", 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339463+0000", 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.358 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339463+0000", 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339468+0000", 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8860000000000003e-06 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339474+0000", 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0410000000000003e-06 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339479+0000", 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9810000000000003e-06 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339520+0000", 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1777999999999999e-05 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.339539+0000", 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8734000000000001e-05 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218159 5.a 5:593efe05:::benchmark_data_smithi045_43640_object69785:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.340120+0000", 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0026728469999999999, 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029945000000000002, 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218159 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340120+0000", 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340120+0000", 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340119+0000", 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340125+0000", 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6149999999999996e-06 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340135+0000", 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8560000000000002e-06 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340142+0000", 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:11:37.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.342001+0000", 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018585920000000001 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.342104+0000", 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000103176 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.342209+0000", 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104641 2024-04-26T12:11:37.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218160 5.7 5:e0ba950e:::benchmark_data_smithi045_43640_object69786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.340155+0000", 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0026377969999999999, 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030540979999999999, 2024-04-26T12:11:37.365 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.366 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.366 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.366 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.366 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.366 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218160 2024-04-26T12:11:37.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340155+0000", 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340155+0000", 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340155+0000", 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340158+0000", 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.74e-06 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340167+0000", 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6339999999999996e-06 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340173+0000", 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341318+0000", 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00114495 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341444+0000", 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000126181 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218161 5.6 5:6ac93b28:::benchmark_data_smithi045_43640_object69787:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.340178+0000", 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0026155290000000001, 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003108928, 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.370 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218161 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340178+0000", 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340178+0000", 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340177+0000", 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340179+0000", 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.119e-06 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340185+0000", 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7599999999999999e-06 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340190+0000", 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7380000000000002e-06 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340228+0000", 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7710000000000003e-05 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340347+0000", 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011929 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.373 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218162 5.3 5:c8c6fa6d:::benchmark_data_smithi045_43640_object69788:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.340221+0000", 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0025718830000000001, 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031468260000000001, 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218162 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.374 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340221+0000", 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340221+0000", 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340221+0000", 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340224+0000", 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4029999999999999e-06 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340232+0000", 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5669999999999997e-06 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340237+0000", 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340279+0000", 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2012999999999999e-05 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.340400+0000", 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000120659 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.377 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218164 5.6 5:6c4a8400:::benchmark_data_smithi045_43640_object69790:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.341765+0000", 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0010277629999999999, 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001680955, 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218164 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341765+0000", 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341765+0000", 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341765+0000", 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341770+0000", 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3369999999999999e-06 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341779+0000", 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3589999999999997e-06 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341786+0000", 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9190000000000002e-06 2024-04-26T12:11:37.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.342273+0000", 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00048684599999999998 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.342345+0000", 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2020000000000005e-05 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:218163 5.b e49/17 5:d194f9a1:::benchmark_data_smithi045_43640_object69789:head v 49'13457, mlcod=49'13455)", 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.341810+0000", 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00098282399999999998, 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001713586, 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341810+0000", 2024-04-26T12:11:37.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341810+0000", 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341810+0000", 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341816+0000", 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6290000000000004e-06 2024-04-26T12:11:37.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341824+0000", 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1070000000000005e-06 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341830+0000", 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.942e-06 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341924+0000", 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3157000000000003e-05 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341935+0000", 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1792e-05 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:218165 5.8 e49/17 5:1ea4b3e4:::benchmark_data_smithi045_43640_object69791:head v 49'13277, mlcod=49'13275)", 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.341840+0000", 2024-04-26T12:11:37.386 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00095321100000000003, 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001749308, 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341840+0000", 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341840+0000", 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341840+0000", 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341843+0000", 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7529999999999999e-06 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341849+0000", 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4330000000000003e-06 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341853+0000", 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2100000000000003e-06 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341885+0000", 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1464000000000002e-05 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341903+0000", 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8544999999999999e-05 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.389 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:218166 5.0 e49/17)", 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.341862+0000", 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00093124400000000002, 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001790895, 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341862+0000", 2024-04-26T12:11:37.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341862+0000", 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341862+0000", 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341869+0000", 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8929999999999999e-06 2024-04-26T12:11:37.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341875+0000", 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7839999999999998e-06 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341880+0000", 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7899999999999999e-06 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.394 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:218169 5.6 5.f6cca186 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.341987+0000", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00080586500000000001, 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001721804, 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 218169 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341987+0000", 2024-04-26T12:11:37.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341987+0000", 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341987+0000", 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341991+0000", 2024-04-26T12:11:37.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0199999999999996e-06 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.341999+0000", 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.342005+0000", 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.195e-06 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:218170 5.0 e49/17)", 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.343269+0000", 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9995241, 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00051010599999999997, 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.343269+0000", 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.343269+0000", 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.343268+0000", 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.343275+0000", 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.343284+0000", 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.343290+0000", 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1310000000000003e-06 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 14 2024-04-26T12:11:37.400 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:37.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:37.443 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:37.441+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:37.545 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:37.542+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:37.605 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:37.605 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:37.605 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:37.605 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:37.605 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:37.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:37.657 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:37.656+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:37.746 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:37.745+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 62.561353935, 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.815 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:37.821 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.835550666000003, 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:37.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:37.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:37.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:37.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.344361634999999, 2024-04-26T12:11:37.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:37.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:37.833 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.342010258999998, 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.340367387999997, 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.838 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:37.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:37.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.328911976000001, 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:37.842 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:37.846 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.325656999000003, 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.847 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:37.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:37.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.323159324000002, 2024-04-26T12:11:37.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.322476023, 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.856 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:37.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:37.860 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.320355507000002, 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:37.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.864 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.318141496000003, 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:37.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.637641940999998, 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:37.869 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:37.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:37.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 30.546750119999999, 2024-04-26T12:11:37.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.877 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:37.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.880 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.763994709999999, 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.881 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.882 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.883 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.762216284000001, 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:37.886 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:37.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.759692090000001, 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:37.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:37.893 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.779423612999999, 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:37.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:37.898 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.9249257479999997, 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:37.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:37.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217992 5.2 5:408cc078:::benchmark_data_smithi045_43640_object69618:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:37.903 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.540107895, 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021913996000000002, 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217992 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272223+0000", 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1660000000000001e-06 2024-04-26T12:11:37.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272229+0000", 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272233+0000", 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.967e-06 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283739+0000", 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011505319999999999 2024-04-26T12:11:37.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283901+0000", 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000161991 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294047+0000", 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010145972 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294081+0000", 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:37.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294135+0000", 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4085000000000001e-05 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.537796787, 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:11:37.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:37.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:11:37.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:11:37.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:11:37.913 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.914 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.914 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.914 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:37.914 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:37.914 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:37.916 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:37.914+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:37.916 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:38.016 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:38.015+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:38.097 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:38.097 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:38.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.097 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220251 5.e 5:71f9b121:::benchmark_data_smithi045_43640_object71877:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.094643+0000", 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0011712750000000001, 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001196482, 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.098 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220251 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094643+0000", 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094643+0000", 2024-04-26T12:11:38.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094642+0000", 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094647+0000", 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094659+0000", 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.2362e-05 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094666+0000", 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4109999999999999e-06 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094702+0000", 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094797+0000", 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4633e-05 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094913+0000", 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116678 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220253 5.e 5.eedb859e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.102 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.095320+0000", 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00049442599999999996, 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00057042799999999999, 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220253 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.095320+0000", 2024-04-26T12:11:38.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.095320+0000", 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.095319+0000", 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.095324+0000", 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2229999999999998e-06 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.095336+0000", 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1615e-05 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.095343+0000", 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4019999999999996e-06 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.105 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220233 5.e 5:7d536a4c:::benchmark_data_smithi045_43640_object71859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.088871+0000", 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0069435529999999999, 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0070599929999999997, 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220233 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.106 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088871+0000", 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088871+0000", 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088870+0000", 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088872+0000", 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.606e-06 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088876+0000", 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088879+0000", 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2119999999999999e-06 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088909+0000", 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0546999999999997e-05 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.088991+0000", 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1540999999999997e-05 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.089054+0000", 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2959000000000005e-05 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092666+0000", 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003611791 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.110 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220238 5.e 5:7aa555a9:::benchmark_data_smithi045_43640_object71864:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.090133+0000", 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0056809950000000003, 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.005842163, 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220238 2024-04-26T12:11:38.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.090133+0000", 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.090133+0000", 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.090132+0000", 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.090136+0000", 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7699999999999999e-06 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.090146+0000", 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7620000000000007e-06 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.090152+0000", 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.083e-06 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.091013+0000", 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00086094199999999996 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.091148+0000", 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000134797 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.091220+0000", 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2371000000000002e-05 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092825+0000", 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001604723 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220245 5.f 5:ffc71066:::benchmark_data_smithi045_43640_object71871:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.115 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.092651+0000", 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.003162893, 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033825909999999999, 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220245 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092651+0000", 2024-04-26T12:11:38.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092651+0000", 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092650+0000", 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092655+0000", 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2220000000000004e-06 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092664+0000", 2024-04-26T12:11:38.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4520000000000003e-06 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092671+0000", 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.148e-06 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092709+0000", 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7682999999999998e-05 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.092840+0000", 2024-04-26T12:11:38.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013102599999999999 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220248 5.f 5:fa4058d2:::benchmark_data_smithi045_43640_object71874:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.093713+0000", 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.002101108, 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023761049999999999, 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.120 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220248 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093713+0000", 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093713+0000", 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093712+0000", 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093716+0000", 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0099999999999997e-06 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093724+0000", 2024-04-26T12:11:38.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5769999999999996e-06 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093729+0000", 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0000000000000004e-06 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094815+0000", 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001086306 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094954+0000", 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000138899 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:220249 5.b 5:d69c77b2:::benchmark_data_smithi045_43640_object71875:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:38.093740+0000", 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00207369, 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023863740000000001, 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.124 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 220249 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093740+0000", 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093740+0000", 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093740+0000", 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093743+0000", 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093749+0000", 2024-04-26T12:11:38.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1909999999999997e-06 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.093753+0000", 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.642e-06 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094665+0000", 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00091193600000000002 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094788+0000", 2024-04-26T12:11:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000123674 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:38.094895+0000", 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010657100000000001 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.128 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.129 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.129 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.129 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:38.129 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 7 2024-04-26T12:11:38.129 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:38.130 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:38.129+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:38.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:38.231 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.229+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:38.306 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:38.306 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:38.306 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:38.306 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:38.306 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:38.326 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:38.368 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.366+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:38.433 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.432+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:38.536 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.533+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.082716007000002, 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.555 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:38.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:38.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.559 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:38.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:38.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.561 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.081100763999999, 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:38.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:38.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:38.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:38.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:38.567 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.078736468999999, 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:38.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:38.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:38.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.164685155999997, 2024-04-26T12:11:38.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.070005576, 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.579 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:38.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.584 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.064797804999998, 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:38.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:38.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.591 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.061598846999999, 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:38.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:38.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.061347038999997, 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:38.597 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:38.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:38.602 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.058691001, 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.603 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:38.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:38.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:38.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.057184231999997, 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:38.608 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.610 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:38.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:38.612 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.613 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:38.614 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.054573779000002, 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:38.616 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:38.618 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:38.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.619 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.619 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.619 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:38.619 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:38.619 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.622 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.622 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.623 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 41.207971120000003, 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.625 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:38.626 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:38.629 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:38.630 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.630 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.630 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.630 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.630 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:38.631 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:38.631 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.256511994999997, 2024-04-26T12:11:38.631 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:38.631 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.631 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.633 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.633 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.633 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.633 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:38.633 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.633 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:38.634 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.636 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.637 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.638 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.504788183999999, 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.639 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.640 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:38.641 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.642 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.643 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.644 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.504679567, 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:38.645 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.646 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.647 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.648 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.649 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.504271024000001, 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.650 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:38.651 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:38.652 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.653 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.654 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.655 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.498815864000001, 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:38.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:38.657 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.658 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.659 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.660 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.661 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 27.372096254999999, 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.662 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:38.663 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:38.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:38.665 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.666 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.766050526000001, 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.667 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:38.668 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.670 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:38.671 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 26.765891108000002, 2024-04-26T12:11:38.672 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.673 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:38.674 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:38.675 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:38.676 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:38.677 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:38.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:38.681 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:38.679+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:38.779 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.778+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:38.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:38.880 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.879+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:38.886 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:38.886 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222518 5.b e49/17 5:d6651913:::benchmark_data_smithi045_43640_object74144:head v 49'13718, mlcod=49'13716)", 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872511+0000", 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001642213, 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016693350000000001, 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872511+0000", 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872511+0000", 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872511+0000", 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.888 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872517+0000", 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1140000000000002e-06 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872526+0000", 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9069999999999996e-06 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872532+0000", 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.229e-06 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872563+0000", 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1102000000000001e-05 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872580+0000", 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7343999999999999e-05 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222519 5.4 e49/17)", 2024-04-26T12:11:38.890 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872713+0000", 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001440139, 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001550215, 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872713+0000", 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.891 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872713+0000", 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872713+0000", 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872718+0000", 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4129999999999997e-06 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.892 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872727+0000", 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8200000000000003e-06 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872734+0000", 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7309999999999996e-06 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222521 5.3 5:c26796d9:::benchmark_data_smithi045_43640_object74147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.873849+0000", 2024-04-26T12:11:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00030463899999999999, 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00047027599999999999, 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222521 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873849+0000", 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873849+0000", 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873848+0000", 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873853+0000", 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1189999999999996e-06 2024-04-26T12:11:38.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873864+0000", 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0499999999999999e-05 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873872+0000", 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9549999999999992e-06 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873923+0000", 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1579999999999997e-05 2024-04-26T12:11:38.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874043+0000", 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011941499999999999 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.897 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222522 5.1 5:844fb3ff:::benchmark_data_smithi045_43640_object74148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.873881+0000", 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00027200100000000001, 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000513048, 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222522 2024-04-26T12:11:38.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873881+0000", 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873881+0000", 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.899 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873881+0000", 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873884+0000", 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873890+0000", 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.900 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.901 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873895+0000", 2024-04-26T12:11:38.901 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1989999999999997e-06 2024-04-26T12:11:38.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873961+0000", 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5121000000000002e-05 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874090+0000", 2024-04-26T12:11:38.902 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012981900000000001 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222524 5.a 5.a9432baa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.874252+0000", 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999018, 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021116200000000001, 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.903 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222524 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874252+0000", 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874252+0000", 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874251+0000", 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874255+0000", 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6020000000000002e-06 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874264+0000", 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8890000000000008e-06 2024-04-26T12:11:38.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874272+0000", 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2169999999999997e-06 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874465+0000", 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00019312999999999999 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222525 5.1 5.6404ce31 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.874285+0000", 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9998684, 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00023942000000000001, 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222525 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874285+0000", 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874285+0000", 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874285+0000", 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874287+0000", 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.723e-06 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.909 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874294+0000", 2024-04-26T12:11:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7499999999999997e-06 2024-04-26T12:11:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874299+0000", 2024-04-26T12:11:38.910 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.468e-06 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222520 5.b e49/17)", 2024-04-26T12:11:38.911 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.874297+0000", 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9998565, 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00028018100000000001, 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.912 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874297+0000", 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874297+0000", 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.913 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874297+0000", 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874301+0000", 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3139999999999997e-06 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874307+0000", 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4609999999999999e-06 2024-04-26T12:11:38.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874311+0000", 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0099999999999997e-06 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874561+0000", 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00024990100000000002 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.915 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874577+0000", 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6742e-05 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222526 5.7 5.c30bd537 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.874619+0000", 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9995341, 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7698000000000001e-05, 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.916 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222526 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874619+0000", 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.917 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874619+0000", 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874619+0000", 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874623+0000", 2024-04-26T12:11:38.918 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7949999999999998e-06 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874632+0000", 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6719999999999993e-06 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.874639+0000", 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6019999999999996e-06 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.919 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.920 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.920 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222502 5.8 e49/17 5:1f080e64:::benchmark_data_smithi045_43640_object74128:head v 49'13532, mlcod=49'13530)", 2024-04-26T12:11:38.920 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.870186+0000", 2024-04-26T12:11:38.921 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0039674580000000001, 2024-04-26T12:11:38.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0045229479999999997, 2024-04-26T12:11:38.921 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.921 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.921 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870186+0000", 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870186+0000", 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870185+0000", 2024-04-26T12:11:38.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870193+0000", 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870203+0000", 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0019e-05 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870210+0000", 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:11:38.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872097+0000", 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00188635 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872116+0000", 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9099000000000001e-05 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222514 5.c 5:3704db87:::benchmark_data_smithi045_43640_object74140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.870470+0000", 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036833109999999999, 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043112560000000003, 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222514 2024-04-26T12:11:38.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870470+0000", 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870470+0000", 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870469+0000", 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870473+0000", 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8519999999999997e-06 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870481+0000", 2024-04-26T12:11:38.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9319999999999996e-06 2024-04-26T12:11:38.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870488+0000", 2024-04-26T12:11:38.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:11:38.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870529+0000", 2024-04-26T12:11:38.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1029999999999998e-05 2024-04-26T12:11:38.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.870670+0000", 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014134400000000001 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.931 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:222517 5.6 5:66530d19:::benchmark_data_smithi045_43640_object74143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872017+0000", 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0021367909999999999, 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028340890000000001, 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:38.932 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:38.933 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 222517 2024-04-26T12:11:38.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.933 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872017+0000", 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872017+0000", 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872016+0000", 2024-04-26T12:11:38.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872021+0000", 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872030+0000", 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4250000000000004e-06 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872038+0000", 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7330000000000003e-06 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872095+0000", 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7655999999999998e-05 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872224+0000", 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012847299999999999 2024-04-26T12:11:38.936 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222507 5.8 e49/17 5:1078622c:::benchmark_data_smithi045_43640_object74133:head v 49'13533, mlcod=49'13530)", 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872075+0000", 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020785280000000001, 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002842429, 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872075+0000", 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872075+0000", 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872074+0000", 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872080+0000", 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6590000000000004e-06 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872088+0000", 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7789999999999996e-06 2024-04-26T12:11:38.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872093+0000", 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3519999999999997e-06 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873791+0000", 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016980770000000001 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873812+0000", 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0658000000000001e-05 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222510 5.0 e49/17 5:060e9488:::benchmark_data_smithi045_43640_object74136:head v 49'13981, mlcod=49'13977)", 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872098+0000", 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020554610000000002, 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028875709999999998, 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.942 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872098+0000", 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872098+0000", 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872098+0000", 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872112+0000", 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4657e-05 2024-04-26T12:11:38.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872118+0000", 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.592e-06 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872122+0000", 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873779+0000", 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00165643 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.873796+0000", 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7428999999999999e-05 2024-04-26T12:11:38.946 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222511 5.4 e49/17 5:2db10395:::benchmark_data_smithi045_43640_object74137:head v 49'14032, mlcod=49'14030)", 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872126+0000", 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020271429999999999, 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029175809999999998, 2024-04-26T12:11:38.947 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872126+0000", 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872126+0000", 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872126+0000", 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872129+0000", 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1590000000000002e-06 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872134+0000", 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872138+0000", 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2309999999999998e-06 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872170+0000", 2024-04-26T12:11:38.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1078999999999998e-05 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872190+0000", 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0058e-05 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.951 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.952 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.952 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:222515 5.0 e49/17)", 2024-04-26T12:11:38.952 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:38.872145+0000", 2024-04-26T12:11:38.952 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020085810000000002, 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0029545800000000001, 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872145+0000", 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:38.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872145+0000", 2024-04-26T12:11:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872145+0000", 2024-04-26T12:11:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872148+0000", 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872155+0000", 2024-04-26T12:11:38.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2899999999999997e-06 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:38.872160+0000", 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3250000000000001e-06 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 15 2024-04-26T12:11:38.956 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:38.958 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:38.980 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:38.979+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:39.032 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:39.057 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:39.060 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:39.060 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:39.082 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:39.081+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:39.152 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:39.152 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:39.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:39.182 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:39.181+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:39.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:11:39.287 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:39.284+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:39.385 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:39.383+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:39.411 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:39.411 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:39.426 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:39.486 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:39.485+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:39.586 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:39.585+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:39.608 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:39.608 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:39.620 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:39.689 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:39.688+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:39.789 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:39.788+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:39.805 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:39.805 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:39.813 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:39.891 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:39.890+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:39.990 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:39.989+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:39.992 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:39.992 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:40.007 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:40.097 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.093+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.193 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:40.192+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:40.204 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:40.204 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:11:40.218 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:40.304 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.303+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.395 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.394+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.455 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:40.455 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:40.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:40.513 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.511+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.597 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.596+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.698 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.697+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.716 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:40.716 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:40.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:40.799 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:40.798+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:40.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-04-26T12:11:40.900 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:40.899+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:40.904 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:40.904 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:40.917 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:41.002 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:41.001+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:41.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:41.104 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:41.102+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:41.155 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:41.205 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:41.204+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:41.241 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:41.263 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:41.266 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:41.267 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:41.305 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:41.303+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:41.378 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:41.378 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:41.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:41.378 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 55.905593517, 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:41.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:41.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:41.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:41.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:41.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:41.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:41.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:41.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:41.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:41.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 55.903978273999996, 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:41.387 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:41.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:41.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:41.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 55.901613978999997, 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.393 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.398 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.987562666000002, 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.892883085999998, 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.404 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:41.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:41.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:41.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:41.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.411 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.887675315000003, 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:41.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:41.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.884476356999997, 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.417 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:41.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.422 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.884224549000002, 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:41.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:41.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.881568510999998, 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:41.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:41.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:41.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.880061742000002, 2024-04-26T12:11:41.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.439 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 51.877451289, 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:41.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:41.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:41.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:41.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:41.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.030848630000001, 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.445 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:41.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:41.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.079389505000002, 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.451 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:41.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:41.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.327665694, 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:41.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:41.462 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.327557077000002, 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:41.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:41.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:41.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.327148533999999, 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.468 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:41.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:41.474 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.321693373999999, 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.475 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.476 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.477 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.478 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.479 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 30.194973765, 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.481 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.481 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.481 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.482 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.483 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.486 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.588928035999999, 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:41.488 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.489 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:41.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 29.588768618, 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:41.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:41.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:41.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:41.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:41.499 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:41.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:41.502 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:41.499+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:41.603 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:41.601+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:41.700 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:41.700 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230392 5.2 5:4f07a4bf:::benchmark_data_smithi045_43640_object82018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.689226+0000", 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0087274080000000007, 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0087571179999999995, 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230392 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.701 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.689226+0000", 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.689226+0000", 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.689226+0000", 2024-04-26T12:11:41.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.689228+0000", 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.83e-06 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.689236+0000", 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.824e-06 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.689242+0000", 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8660000000000002e-06 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691128+0000", 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018859580000000001 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691258+0000", 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000130173 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.704 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230396 5.2 5:49f83d2a:::benchmark_data_smithi045_43640_object82022:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.691575+0000", 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0063783989999999999, 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0064968689999999997, 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230396 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691575+0000", 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691575+0000", 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691574+0000", 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691580+0000", 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-06 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691593+0000", 2024-04-26T12:11:41.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2622e-05 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691602+0000", 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1030000000000008e-06 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.692802+0000", 2024-04-26T12:11:41.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001200652 2024-04-26T12:11:41.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.692930+0000", 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012755199999999999 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230397 5.1 5:875e3d0d:::benchmark_data_smithi045_43640_object82023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.691611+0000", 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0063420239999999999, 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0065344920000000003, 2024-04-26T12:11:41.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230397 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691611+0000", 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.712 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691611+0000", 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691611+0000", 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691614+0000", 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691622+0000", 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9869999999999999e-06 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691628+0000", 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8459999999999996e-06 2024-04-26T12:11:41.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691664+0000", 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5833000000000001e-05 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.691792+0000", 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012838500000000001 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.715 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:230401 5.0 e50/17 5:077b6923:::benchmark_data_smithi045_43640_object82027:head v 50'14446, mlcod=50'14444)", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.693787+0000", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004166767, 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0044379859999999997, 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693787+0000", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693787+0000", 2024-04-26T12:11:41.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693786+0000", 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693792+0000", 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7810000000000002e-06 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693800+0000", 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4889999999999995e-06 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693807+0000", 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4269999999999996e-06 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693836+0000", 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8938999999999999e-05 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693847+0000", 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1399999999999999e-05 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230402 5.2 5:4570ef48:::benchmark_data_smithi045_43640_object82028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.693948+0000", 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0040052259999999998, 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043445269999999999, 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.719 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230402 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693948+0000", 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693948+0000", 2024-04-26T12:11:41.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693948+0000", 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693951+0000", 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.79e-06 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693958+0000", 2024-04-26T12:11:41.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5050000000000001e-06 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.693964+0000", 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694752+0000", 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00078762299999999999 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694870+0000", 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118058 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230406 5.2 5:4098c924:::benchmark_data_smithi045_43640_object82032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.694289+0000", 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036649170000000002, 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004078422, 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.723 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230406 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694289+0000", 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694289+0000", 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694288+0000", 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694293+0000", 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8949999999999997e-06 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694306+0000", 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3349e-05 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694314+0000", 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696520+0000", 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022058580000000002 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696593+0000", 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3069000000000001e-05 2024-04-26T12:11:41.726 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230408 5.1 5:8590a53f:::benchmark_data_smithi045_43640_object82034:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.694324+0000", 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0036297909999999998, 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0041160210000000001, 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230408 2024-04-26T12:11:41.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694324+0000", 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694324+0000", 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694321+0000", 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999971 2024-04-26T12:11:41.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694326+0000", 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3029999999999999e-06 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694333+0000", 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694348+0000", 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4734e-05 2024-04-26T12:11:41.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694420+0000", 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1600000000000006e-05 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.694565+0000", 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014520000000000001 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:230403 5.0 e50/17 5:0df04692:::benchmark_data_smithi045_43640_object82029:head v 50'14447, mlcod=50'14444)", 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.695882+0000", 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0020710289999999998, 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026317760000000002, 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695882+0000", 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695882+0000", 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695882+0000", 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695888+0000", 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4649999999999999e-06 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695898+0000", 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3600000000000002e-06 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695904+0000", 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5490000000000003e-06 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695936+0000", 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2004000000000001e-05 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.695953+0000", 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6752000000000002e-05 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230411 5.a 5:5cd8f55e:::benchmark_data_smithi045_43640_object82037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.696009+0000", 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0019441490000000001, 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025679919999999998, 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:41.734 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230411 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696009+0000", 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696009+0000", 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696008+0000", 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696014+0000", 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5790000000000003e-06 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696023+0000", 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4350000000000003e-06 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.696030+0000", 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6150000000000002e-06 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698081+0000", 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020510670000000002 2024-04-26T12:11:41.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698191+0000", 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110109 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698296+0000", 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104675 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230413 5.a 5.9701eb4a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697134+0000", 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00081941999999999996, 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001513094, 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230413 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697134+0000", 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697134+0000", 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697133+0000", 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697138+0000", 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7879999999999997e-06 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697162+0000", 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3575e-05 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697171+0000", 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3139999999999993e-06 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.741 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230414 5.5 5:a7e650cc:::benchmark_data_smithi045_43640_object82040:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697236+0000", 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00071781700000000004, 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014667479999999999, 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230414 2024-04-26T12:11:41.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697236+0000", 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697236+0000", 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697235+0000", 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697240+0000", 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4229999999999996e-06 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697255+0000", 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4555999999999999e-05 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697262+0000", 2024-04-26T12:11:41.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5290000000000003e-06 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697308+0000", 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5744000000000001e-05 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697461+0000", 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015271600000000001 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:230412 5.8 e50/17 5:1d2ce4e3:::benchmark_data_smithi045_43640_object82038:head v 50'14054, mlcod=50'14052)", 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697249+0000", 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00070436000000000001, 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001529159, 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697249+0000", 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697249+0000", 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697249+0000", 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697254+0000", 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8080000000000001e-06 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697263+0000", 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3350000000000007e-06 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697269+0000", 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.117e-06 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697481+0000", 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00021262000000000001 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697501+0000", 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9700000000000001e-05 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:230410 5.0 e50/17 5:097f6288:::benchmark_data_smithi045_43640_object82036:head v 50'14448, mlcod=50'14444)", 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697507+0000", 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00044651599999999999, 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00133424, 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.749 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697507+0000", 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697507+0000", 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697506+0000", 2024-04-26T12:11:41.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697512+0000", 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4739999999999996e-06 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697520+0000", 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2910000000000007e-06 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697527+0000", 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0809999999999996e-06 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697567+0000", 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0166999999999997e-05 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697584+0000", 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6532999999999999e-05 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230415 5.2 5.314f1d52 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697865+0000", 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8826999999999995e-05, 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010403109999999999, 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.753 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230415 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697865+0000", 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697865+0000", 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697864+0000", 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697869+0000", 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9620000000000001e-06 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697879+0000", 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7289999999999995e-06 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697885+0000", 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9800000000000001e-06 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230416 5.1 5.1df19c21 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697892+0000", 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 6.1741000000000004e-05, 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0010729450000000001, 2024-04-26T12:11:41.757 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230416 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697892+0000", 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697892+0000", 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697891+0000", 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697894+0000", 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1619999999999998e-06 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697899+0000", 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.716e-06 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697904+0000", 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7849999999999999e-06 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230417 5.3 5:c00d5a05:::benchmark_data_smithi045_43640_object82043:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.760 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.697913+0000", 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.0525999999999998e-05, 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011232, 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230417 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697913+0000", 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697913+0000", 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697913+0000", 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:41.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697915+0000", 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.232e-06 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697920+0000", 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4249999999999997e-06 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697925+0000", 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:11:41.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.697962+0000", 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7005999999999998e-05 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698082+0000", 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000119794 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.764 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:230418 5.3 5.81b33013 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:41.698499+0000", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.999455, 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00060985599999999998, 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 230418 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698499+0000", 2024-04-26T12:11:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698499+0000", 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698498+0000", 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:41.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698503+0000", 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3040000000000004e-06 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698512+0000", 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9299999999999992e-06 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:41.698519+0000", 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2010000000000002e-06 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:41.767 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:41.768 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 17 2024-04-26T12:11:41.768 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:41.769 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:41.768+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:41.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:41.876 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:41.872+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:41.971 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:41.970+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:42.016 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:42.016 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:42.017 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:42.017 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:42.017 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:42.033 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:42.074 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:42.073+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:42.178 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:42.173+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:42.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:11:42.269 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 67.015475469999998, 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.270 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:42.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:42.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 62.289672201000002, 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:42.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:42.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:42.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:42.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 56.798483169999997, 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.282 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:42.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:42.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 56.796131793999997, 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 56.794488923000003, 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.291 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.293 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.783033510999999, 2024-04-26T12:11:42.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:42.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:42.299 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.779778534000002, 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:42.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:42.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.777280859000001, 2024-04-26T12:11:42.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:42.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.776597557999999, 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.314 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.316 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.774477042000001, 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:42.318 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:42.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:42.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 52.772263031000001, 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:42.321 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.322 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:42.323 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:42.324 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 45.091763475999997, 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:42.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.326 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.327 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.328 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.329 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.000871654999997, 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.330 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.332 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.333 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.334 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:42.335 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.218116245000001, 2024-04-26T12:11:42.336 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:42.336 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.336 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.336 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.337 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.338 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.339 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.340 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.216337819, 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.341 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:42.342 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:42.343 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.344 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:42.345 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.213813625, 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.346 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:42.347 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.348 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.349 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.233545148000001, 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.350 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.351 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:42.352 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.353 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:42.354 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:42.354 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.354 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.354 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.354 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.355 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.356 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.356 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:42.356 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.379047283, 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.357 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.358 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.359 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.360 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:42.361 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.363 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217992 5.2 5:408cc078:::benchmark_data_smithi045_43640_object69618:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9942294299999999, 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021913996000000002, 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.364 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217992 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.366 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.366 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272223+0000", 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1660000000000001e-06 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.367 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272229+0000", 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272233+0000", 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.967e-06 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283739+0000", 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011505319999999999 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283901+0000", 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000161991 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294047+0000", 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010145972 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294081+0000", 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294135+0000", 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4085000000000001e-05 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.9919183220000001, 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:42.370 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:42.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.375 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.376 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.376 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:42.376 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:42.376 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:42.377 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:42.376+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:42.378 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:42.479 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:42.478+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:232832 5.9 5:988e0d30:::benchmark_data_smithi045_43640_object84458:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:42.554869+0000", 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0042538319999999999, 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042768700000000003, 2024-04-26T12:11:42.560 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 232832 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.554869+0000", 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.554869+0000", 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.554868+0000", 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.554872+0000", 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.554881+0000", 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3280000000000006e-06 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.554887+0000", 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1879999999999999e-06 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556881+0000", 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001994334 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556994+0000", 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000112488 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:232834 5.b 5:d7dd04cb:::benchmark_data_smithi045_43640_object84460:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:42.556053+0000", 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0030692060000000001, 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031460379999999999, 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 232834 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556053+0000", 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556053+0000", 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556053+0000", 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556056+0000", 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556063+0000", 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1219999999999997e-06 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556070+0000", 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4919999999999998e-06 2024-04-26T12:11:42.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556107+0000", 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7117999999999999e-05 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556213+0000", 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010626 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556310+0000", 2024-04-26T12:11:42.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.7065999999999995e-05 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558851+0000", 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0025407530000000002 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:232839 5.e 5:7a451a72:::benchmark_data_smithi045_43640_object84465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:42.556397+0000", 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0027250059999999999, 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0028482569999999999, 2024-04-26T12:11:42.569 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 232839 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556397+0000", 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556397+0000", 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556397+0000", 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556401+0000", 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1729999999999997e-06 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556407+0000", 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5089999999999999e-06 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.556412+0000", 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5879999999999999e-06 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557004+0000", 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00059248099999999995 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557115+0000", 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110188 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557221+0000", 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000105877 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.573 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:232843 5.e 5:75bf10b5:::benchmark_data_smithi045_43640_object84469:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:42.557205+0000", 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0019173199999999999, 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020809689999999998, 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 232843 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557205+0000", 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557205+0000", 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557204+0000", 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557208+0000", 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.439e-06 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557214+0000", 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1720000000000004e-06 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.557219+0000", 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5680000000000001e-06 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558918+0000", 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001699164 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558989+0000", 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1367999999999998e-05 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559058+0000", 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8880000000000005e-05 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:232846 5.9 5:937e64c1:::benchmark_data_smithi045_43640_object84472:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:42.558855+0000", 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00026765699999999998, 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00047296300000000002, 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 232846 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558855+0000", 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558855+0000", 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558854+0000", 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558859+0000", 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.13e-06 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558867+0000", 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3729999999999993e-06 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558875+0000", 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.109e-06 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.558964+0000", 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.9875000000000003e-05 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559079+0000", 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000114678 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:232842 5.a e50/17)", 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:42.559334+0000", 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997883, 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.1022999999999998e-05, 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559334+0000", 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559334+0000", 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559333+0000", 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559340+0000", 2024-04-26T12:11:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5050000000000004e-06 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559350+0000", 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0346999999999999e-05 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:42.559357+0000", 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.472e-06 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:42.585 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:42.585 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 6 2024-04-26T12:11:42.585 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:42.586 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:42.587 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:42.585+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:42.686 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:42.685+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:42.788 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:42.787+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:42.803 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:42.803 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:42.803 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:42.803 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:42.804 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:42.817 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:42.902 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:42.901+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:42.989 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:42.988+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:43.042 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.570813952000002, 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:43.043 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.045 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.046 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:43.047 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:43.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.569198708999998, 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.049 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.052 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:43.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.566834413999999, 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:43.054 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.057 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:43.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:43.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:43.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.652783100999997, 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.061 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:43.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:43.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:43.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.558103521, 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.067 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.068 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:43.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.072 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.552895749999998, 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:43.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:43.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:43.079 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.549696791999999, 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:43.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:43.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:43.085 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.549444983999997, 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:43.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:43.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.546788945999999, 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:43.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.545282176999997, 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.097 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:43.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:43.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:43.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.542671724000002, 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.103 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:43.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:43.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.696069065000003, 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:43.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:43.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.744609939999997, 2024-04-26T12:11:43.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:43.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:43.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.992886128999999, 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:43.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.992777512, 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:43.126 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.128 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.129 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:43.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.992368969000001, 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.132 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.135 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:43.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:43.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.986913809000001, 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.139 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.141 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:43.143 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:43.144 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.860194199999999, 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.145 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.146 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:43.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.254148471000001, 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.151 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 31.253989053000002, 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:43.156 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:43.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:43.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:43.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:43.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:43.161 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:43.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:43.163 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:43.161+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:43.222 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:11:43.263 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:43.262+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:43.267 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:43.365 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:43.364+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:43.368 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:43.368 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:43.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235154 5.a 5:572d6ffd:::benchmark_data_smithi045_43640_object86780:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.358629+0000", 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.005891472, 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005918347, 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235154 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358629+0000", 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358629+0000", 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.370 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358628+0000", 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358633+0000", 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1599999999999997e-06 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358640+0000", 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8299999999999998e-06 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.371 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358645+0000", 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2669999999999997e-06 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358690+0000", 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5629e-05 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.372 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358825+0000", 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013491100000000001 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358944+0000", 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011841900000000001 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235158 5.2 5:48889184:::benchmark_data_smithi045_43640_object86784:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.373 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.358667+0000", 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0058529879999999999, 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059718260000000004, 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235158 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.374 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358667+0000", 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358667+0000", 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358667+0000", 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.375 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358669+0000", 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.204e-06 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358675+0000", 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358680+0000", 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2660000000000001e-06 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.376 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358726+0000", 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5606999999999999e-05 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.358862+0000", 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013652400000000001 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.377 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235160 5.7 5:ea8a2d4d:::benchmark_data_smithi045_43640_object86786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.359202+0000", 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0053181299999999999, 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055144319999999997, 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235160 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.378 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359202+0000", 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359202+0000", 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359202+0000", 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.379 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359204+0000", 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.216e-06 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359210+0000", 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8930000000000002e-06 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359214+0000", 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5850000000000001e-06 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362431+0000", 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0032166270000000001 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362558+0000", 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012658299999999999 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235161 5.a 5:5267fc9d:::benchmark_data_smithi045_43640_object86787:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.359775+0000", 2024-04-26T12:11:43.381 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0047452149999999997, 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0050189370000000002, 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235161 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359775+0000", 2024-04-26T12:11:43.382 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359775+0000", 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359774+0000", 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.383 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359779+0000", 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8910000000000003e-06 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359788+0000", 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0990000000000005e-06 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359795+0000", 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0530000000000001e-06 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.384 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360995+0000", 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001199536 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.361112+0000", 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011718900000000001 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.361218+0000", 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010631100000000001 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.385 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235168 5.a 5:55a4a592:::benchmark_data_smithi045_43640_object86794:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.359985+0000", 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0045348130000000004, 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0048527969999999998, 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.386 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235168 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359985+0000", 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359985+0000", 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.387 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359985+0000", 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359988+0000", 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.835e-06 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.359995+0000", 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.388 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360000+0000", 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8669999999999999e-06 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363175+0000", 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0031745190000000002 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363289+0000", 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113659 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363393+0000", 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104332 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:235164 5.0 e51/17 5:0d5c4439:::benchmark_data_smithi045_43640_object86790:head v 51'14764, mlcod=51'14762)", 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.360193+0000", 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004327137, 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046872379999999998, 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.390 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360193+0000", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360193+0000", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360193+0000", 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360197+0000", 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1359999999999999e-06 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360203+0000", 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3080000000000004e-06 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360208+0000", 2024-04-26T12:11:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360247+0000", 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8945000000000001e-05 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360264+0000", 2024-04-26T12:11:43.393 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7805e-05 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:235162 5.8 e51/17 5:176a00bc:::benchmark_data_smithi045_43640_object86788:head v 51'14363, mlcod=51'14361)", 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.360217+0000", 2024-04-26T12:11:43.394 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0043035879999999997, 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046969129999999996, 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360217+0000", 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360217+0000", 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360217+0000", 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360219+0000", 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.96e-06 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360224+0000", 2024-04-26T12:11:43.396 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9350000000000002e-06 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.360229+0000", 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5839999999999996e-06 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362275+0000", 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020457169999999998 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.397 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362292+0000", 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7118000000000001e-05 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.398 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:235154 5.a e51/17)", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.362168+0000", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023522759999999999, 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027877370000000002, 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362168+0000", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362168+0000", 2024-04-26T12:11:43.399 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362167+0000", 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362172+0000", 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5349999999999998e-06 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362181+0000", 2024-04-26T12:11:43.400 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6400000000000003e-06 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362187+0000", 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.319e-06 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:235166 5.4 e51/17 5:258108c1:::benchmark_data_smithi045_43640_object86792:head v 51'14826, mlcod=51'14823)", 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.362192+0000", 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023286510000000002, 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028060609999999999, 2024-04-26T12:11:43.401 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362192+0000", 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362192+0000", 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362191+0000", 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362196+0000", 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3080000000000001e-06 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362202+0000", 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.403 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363757+0000", 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0015552610000000001 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363795+0000", 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8053000000000003e-05 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363815+0000", 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9646000000000001e-05 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.404 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235170 5.1 5:88bb663e:::benchmark_data_smithi045_43640_object86796:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.362189+0000", 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0023308880000000001, 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028561419999999999, 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235170 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.405 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362189+0000", 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362189+0000", 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362188+0000", 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.406 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362194+0000", 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8830000000000003e-06 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362211+0000", 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6436e-05 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362220+0000", 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6299999999999993e-06 2024-04-26T12:11:43.407 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362643+0000", 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00042289600000000002 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.362783+0000", 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014000899999999999 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.408 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:235169 5.e e51/17 5:7bd28d64:::benchmark_data_smithi045_43640_object86795:head v 51'14734, mlcod=51'14732)", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.363781+0000", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00073975899999999999, 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001327139, 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363781+0000", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363781+0000", 2024-04-26T12:11:43.409 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363780+0000", 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363786+0000", 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0240000000000003e-06 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363794+0000", 2024-04-26T12:11:43.410 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.61e-06 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363800+0000", 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9510000000000003e-06 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363883+0000", 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3628000000000006e-05 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.411 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363902+0000", 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8674000000000001e-05 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:235173 5.0 e51/17 5:0ab7fcaa:::benchmark_data_smithi045_43640_object86799:head v 51'14765, mlcod=51'14762)", 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.363809+0000", 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00071100600000000003, 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00136495, 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.412 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363809+0000", 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363809+0000", 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363809+0000", 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967296 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.413 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363813+0000", 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.579e-06 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363818+0000", 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3349999999999997e-06 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.363822+0000", 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1459999999999998e-06 2024-04-26T12:11:43.414 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364289+0000", 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000466954 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364306+0000", 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.6602000000000001e-05 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.415 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235174 5.7 5:e6b5da77:::benchmark_data_smithi045_43640_object86800:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.364197+0000", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00032295199999999999, 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001050481, 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235174 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364197+0000", 2024-04-26T12:11:43.416 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364197+0000", 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364196+0000", 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364202+0000", 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364213+0000", 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364221+0000", 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7340000000000008e-06 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.418 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364268+0000", 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6758000000000002e-05 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364385+0000", 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000117637 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235175 5.3 5.94f61b63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.364333+0000", 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000187188, 2024-04-26T12:11:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00098728500000000007, 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235175 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364333+0000", 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.420 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364333+0000", 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364332+0000", 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364336+0000", 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.619e-06 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.421 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364344+0000", 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7780000000000007e-06 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364350+0000", 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2230000000000004e-06 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235176 5.2 5:4f4479bb:::benchmark_data_smithi045_43640_object86802:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.422 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.364835+0000", 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9996848, 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000552587, 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235176 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364835+0000", 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.423 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364835+0000", 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364834+0000", 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364839+0000", 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3069999999999996e-06 2024-04-26T12:11:43.424 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364850+0000", 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1554e-05 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.364857+0000", 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6499999999999999e-06 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365082+0000", 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00022513000000000001 2024-04-26T12:11:43.425 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365213+0000", 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013136699999999999 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235177 5.3 5.bc7dcd73 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.365317+0000", 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9992037, 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000148004, 2024-04-26T12:11:43.426 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235177 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365317+0000", 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.427 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365317+0000", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365316+0000", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365321+0000", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8180000000000003e-06 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365330+0000", 2024-04-26T12:11:43.428 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3719999999999994e-06 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365337+0000", 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9410000000000001e-06 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:235178 5.6 5.a117ead6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:43.365343+0000", 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9991775, 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000175281, 2024-04-26T12:11:43.429 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 235178 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365343+0000", 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.430 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365343+0000", 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365343+0000", 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365345+0000", 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.3920000000000001e-06 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.431 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365351+0000", 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.665e-06 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:43.365355+0000", 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5709999999999999e-06 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 17 2024-04-26T12:11:43.432 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:43.434 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:43.438 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:43.462 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:43.462 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:43.465 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:43.464+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:43.465 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:43.466 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:43.566 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:43.565+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:43.666 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:43.665+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:43.673 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:43.673 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:43.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:43.769 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:43.768+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:43.869 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:43.868+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:43.922 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:43.922 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:43.937 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:43.978 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:43.977+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:44.072 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:44.069+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:44.115 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:44.115 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:44.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:44.172 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:44.171+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:44.273 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:44.272+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:44.344 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:44.344 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:44.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:44.373 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:44.372+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:44.474 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:44.473+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:44.575 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:44.574+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:44.617 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:44.617 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:44.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:44.678 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:44.676+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:44.776 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:44.775+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:44.822 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:44.822 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:44.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:44.878 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:44.877+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:44.978 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:44.977+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:45.059 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:45.059 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:45.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:45.119 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:45.118+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:45.180 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:45.179+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:45.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:11:45.281 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:45.280+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:45.285 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:45.285 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:45.300 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:45.385 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:45.382+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:45.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:45.481 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:45.481 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:45.484 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:45.483+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:45.498 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:45.586 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:45.585+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:45.677 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:45.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:45.687 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:45.685+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:45.719 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:45.719 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:45.719 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:45.719 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:45.719 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:45.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:45.787 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:45.786+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:45.888 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:45.887+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.436883199, 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.909 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.435267955999997, 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:45.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:45.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:45.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:45.921 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.432903660999997, 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:45.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.518852348000003, 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:45.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:45.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.424172767999998, 2024-04-26T12:11:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:45.938 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.418964997000003, 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:45.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:45.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:45.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:45.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:45.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.415766038999998, 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:45.944 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.415514231000003, 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.950 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:45.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:45.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.955 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.412858192999998, 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:45.961 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.411351424000003, 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:45.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:45.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:45.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.967 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 56.408740971, 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:45.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:45.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:45.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:45.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.562138312000002, 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:45.973 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.610679187000002, 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:45.979 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:45.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:45.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.984 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.858955375999997, 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:45.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:45.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:45.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:45.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:45.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.858846759000002, 2024-04-26T12:11:45.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.995 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.858438216000003, 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.996 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:45.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:46.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:46.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:46.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:46.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.002 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.852983055999999, 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.009 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.726263447000001, 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:46.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:46.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:46.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:46.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.120217717999999, 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:46.016 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:46.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:46.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:46.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:46.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.020 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.019+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:46.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:46.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 34.120058299999997, 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:46.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:46.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:46.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.027 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:46.028 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:46.028 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:46.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:46.123 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.122+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:46.224 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.221+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:46.224 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:11:46.227 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243190 5.1 5:86f936c9:::benchmark_data_smithi045_43640_object94816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.222028+0000", 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0041871549999999997, 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042183949999999998, 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243190 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222028+0000", 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222028+0000", 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222027+0000", 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222032+0000", 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0010000000000001e-06 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222042+0000", 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6490000000000003e-06 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222051+0000", 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1160000000000005e-06 2024-04-26T12:11:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224382+0000", 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023317160000000002 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224511+0000", 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000128181 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243195 5.5 5.2fa0e245 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.223923+0000", 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0022921170000000002, 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024067670000000002, 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243195 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223923+0000", 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223923+0000", 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223922+0000", 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223927+0000", 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2750000000000003e-06 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223938+0000", 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0774000000000001e-05 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223945+0000", 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.746e-06 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243196 5.1 5.c980c801 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.223955+0000", 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0022599439999999998, 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002441258, 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243196 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223955+0000", 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223955+0000", 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223955+0000", 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223957+0000", 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4609999999999998e-06 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223963+0000", 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.626e-06 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223968+0000", 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1919999999999996e-06 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:243194 5.8 e52/17 5:1602d53b:::benchmark_data_smithi045_43640_object94820:head v 52'14850, mlcod=51'14848)", 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.224165+0000", 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.002049398, 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0022961069999999999, 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.238 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224165+0000", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224165+0000", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224165+0000", 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224170+0000", 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2889999999999997e-06 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224178+0000", 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7230000000000004e-06 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224183+0000", 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1490000000000002e-06 2024-04-26T12:11:46.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224225+0000", 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1662000000000002e-05 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224242+0000", 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7523000000000001e-05 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.241 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243197 5.5 5.1dd8dfc5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.226252+0000", 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999628, 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00028541999999999999, 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243197 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226252+0000", 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226252+0000", 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226251+0000", 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226257+0000", 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3010000000000003e-06 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226267+0000", 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0142e-05 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226275+0000", 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243198 5.5 5.d2c8b555 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.226487+0000", 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9997282, 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113912, 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243198 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226487+0000", 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226487+0000", 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226486+0000", 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226490+0000", 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0679999999999998e-06 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226499+0000", 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4880000000000007e-06 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.226506+0000", 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.063e-06 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.247 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243183 5.7 5:e6404053:::benchmark_data_smithi045_43640_object94809:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.221025+0000", 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0051903260000000003, 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056563259999999997, 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243183 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.248 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221025+0000", 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221025+0000", 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221023+0000", 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221029+0000", 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5589999999999996e-06 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221039+0000", 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.8390000000000002e-06 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221048+0000", 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.5060000000000001e-06 2024-04-26T12:11:46.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221085+0000", 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6879999999999999e-05 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221218+0000", 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013255 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.251 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243184 5.2 5:426d8915:::benchmark_data_smithi045_43640_object94810:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.221061+0000", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0051538260000000002, 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00570821, 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243184 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221061+0000", 2024-04-26T12:11:46.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221061+0000", 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221061+0000", 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221063+0000", 2024-04-26T12:11:46.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7590000000000002e-06 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221069+0000", 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9529999999999996e-06 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221074+0000", 2024-04-26T12:11:46.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9400000000000001e-06 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223151+0000", 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020765190000000002 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.223278+0000", 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012676899999999999 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243185 5.7 5:eee2b958:::benchmark_data_smithi045_43640_object94811:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.221084+0000", 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0051311439999999998, 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057384059999999997, 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243185 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221084+0000", 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221084+0000", 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221083+0000", 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221086+0000", 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1890000000000001e-06 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221092+0000", 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9730000000000002e-06 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221097+0000", 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2220000000000001e-06 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.225439+0000", 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043423419999999999 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.225564+0000", 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012531900000000001 2024-04-26T12:11:46.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:243186 5.3 5:c1768af3:::benchmark_data_smithi045_43640_object94812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.221102+0000", 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0051129679999999999, 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057616000000000004, 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.260 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 243186 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221102+0000", 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221102+0000", 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221101+0000", 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221104+0000", 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1849999999999998e-06 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221109+0000", 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6749999999999999e-06 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221115+0000", 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0390000000000001e-06 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224480+0000", 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033642160000000002 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.224589+0000", 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000109694 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:243181 5.0 e52/17 5:06ad119e:::benchmark_data_smithi045_43640_object94807:head v 52'15261, mlcod=51'15259)", 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:46.221416+0000", 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0047993109999999997, 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005494222, 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221416+0000", 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221416+0000", 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221415+0000", 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221418+0000", 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2459999999999999e-06 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221424+0000", 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8649999999999998e-06 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.221429+0000", 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3850000000000004e-06 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222043+0000", 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000613954 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:46.222061+0000", 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7861000000000001e-05 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 11 2024-04-26T12:11:46.267 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:46.269 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:46.354 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.353+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:46.424 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.423+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:46.511 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:46.511 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:46.511 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:46.511 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:46.511 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:46.524 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:46.523+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:46.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:46.640 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.634+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:46.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-04-26T12:11:46.726 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:46.725+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 71.509461544999994, 2024-04-26T12:11:46.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:46.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:46.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:46.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.783658275999997, 2024-04-26T12:11:46.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:46.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:46.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:46.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.292469244999999, 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.775 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:46.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:46.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.290117868999999, 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.780 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.782 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:46.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:46.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87780 5.4 e31/17 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head v 31'5546, mlcod=31'5542)", 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.288474997999998, 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020894784999999999, 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.787 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471962+0000", 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.471961+0000", 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472019+0000", 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7917999999999997e-05 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472027+0000", 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.49e-06 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.472034+0000", 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475115+0000", 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030808419999999999 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.475138+0000", 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2668e-05 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492837+0000", 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.017699085 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492856+0000", 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9440999999999999e-05 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.277019586000002, 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.791 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:46.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:46.795 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.273764608999997, 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:46.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.800 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.271266934000003, 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.801 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:46.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:46.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.806 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.270583633000001, 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.268463117000003, 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:46.811 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:46.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:46.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:46.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:46.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:46.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.818 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.266249105999997, 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.819 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:46.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:46.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 49.585749550999999, 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.824 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:46.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:46.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:46.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.832 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.49485773, 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.833 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:46.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:46.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:46.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.71210232, 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.710323893999998, 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.843 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:46.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.707799700000002, 2024-04-26T12:11:46.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:46.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:46.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:46.852 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.727531223, 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.853 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:46.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:46.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:46.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:46.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 17.873033358000001, 2024-04-26T12:11:46.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:46.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:46.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217992 5.2 5:408cc078:::benchmark_data_smithi045_43640_object69618:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.4882155049999994, 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021913996000000002, 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.865 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217992 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272223+0000", 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1660000000000001e-06 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272229+0000", 2024-04-26T12:11:46.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272233+0000", 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.967e-06 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283739+0000", 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011505319999999999 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283901+0000", 2024-04-26T12:11:46.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000161991 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294047+0000", 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010145972 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294081+0000", 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294135+0000", 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4085000000000001e-05 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.4859043970000005, 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:11:46.870 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:46.871 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.872 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:11:46.876 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.877 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.877 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.877 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:46.877 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:46.877 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:46.878 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:46.877+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:46.879 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:46.979 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:46.978+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245528 5.0 5:0dc65af9:::benchmark_data_smithi045_43640_object97154:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.062887+0000", 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0044943989999999996, 2024-04-26T12:11:47.069 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045194659999999998, 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245528 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.062887+0000", 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.070 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.062887+0000", 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.062887+0000", 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.062889+0000", 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2239999999999998e-06 2024-04-26T12:11:47.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.062895+0000", 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.062900+0000", 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8949999999999997e-06 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064379+0000", 2024-04-26T12:11:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014788399999999999 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064489+0000", 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109943 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064606+0000", 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117197 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245532 5.e 5:71d8488b:::benchmark_data_smithi045_43640_object97158:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.064399+0000", 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0029821930000000002, 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003089348, 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245532 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064399+0000", 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064399+0000", 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064398+0000", 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064404+0000", 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2959999999999998e-06 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064413+0000", 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8200000000000003e-06 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064421+0000", 2024-04-26T12:11:47.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1119999999999996e-06 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064465+0000", 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4450999999999998e-05 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064593+0000", 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127809 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.064711+0000", 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011841399999999999 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.067322+0000", 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002610345 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245534 5.8 5:15a3d510:::benchmark_data_smithi045_43640_object97160:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.065563+0000", 2024-04-26T12:11:47.078 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0018183699999999999, 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020044759999999998, 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245534 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065563+0000", 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065563+0000", 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065562+0000", 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065567+0000", 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.578e-06 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065581+0000", 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.4433999999999999e-05 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065590+0000", 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1720000000000007e-06 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066698+0000", 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001108138 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066843+0000", 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014562200000000001 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066943+0000", 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9450000000000005e-05 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.082 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245535 5.4 5:2ba3c324:::benchmark_data_smithi045_43640_object97161:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.065601+0000", 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0017802530000000001, 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020418010000000002, 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245535 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065601+0000", 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065601+0000", 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.084 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065601+0000", 2024-04-26T12:11:47.085 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065603+0000", 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7360000000000001e-06 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065610+0000", 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9709999999999998e-06 2024-04-26T12:11:47.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065616+0000", 2024-04-26T12:11:47.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5709999999999997e-06 2024-04-26T12:11:47.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065654+0000", 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7517e-05 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065773+0000", 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119541 2024-04-26T12:11:47.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065896+0000", 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000123022 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245536 5.b 5:d472a9c2:::benchmark_data_smithi045_43640_object97162:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.065623+0000", 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0017582330000000001, 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002098801, 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.092 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245536 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065623+0000", 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065623+0000", 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065623+0000", 2024-04-26T12:11:47.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065625+0000", 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0849999999999999e-06 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065631+0000", 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5430000000000001e-06 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065635+0000", 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3409999999999996e-06 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065669+0000", 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3739999999999999e-05 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065780+0000", 2024-04-26T12:11:47.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111012 2024-04-26T12:11:47.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065890+0000", 2024-04-26T12:11:47.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110061 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245537 5.0 5:05b7287f:::benchmark_data_smithi045_43640_object97163:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.065643+0000", 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001738311, 2024-04-26T12:11:47.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002161638, 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245537 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065643+0000", 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.100 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065643+0000", 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065643+0000", 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.101 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065645+0000", 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1289999999999999e-06 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065650+0000", 2024-04-26T12:11:47.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3809999999999998e-06 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065655+0000", 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5759999999999999e-06 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066824+0000", 2024-04-26T12:11:47.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011690279999999999 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066946+0000", 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012225300000000001 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.067056+0000", 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110072 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245538 5.4 5.8f3e83c4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.065737+0000", 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0016445570000000001, 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002159308, 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245538 2024-04-26T12:11:47.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065737+0000", 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065737+0000", 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065736+0000", 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065740+0000", 2024-04-26T12:11:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2430000000000001e-06 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065747+0000", 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0210000000000002e-06 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.065752+0000", 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3990000000000003e-06 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.110 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:245540 5.8 5.c6119ae8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.110 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.066020+0000", 2024-04-26T12:11:47.110 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001361599, 2024-04-26T12:11:47.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019375320000000001, 2024-04-26T12:11:47.110 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.110 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 245540 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066020+0000", 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066020+0000", 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066019+0000", 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066023+0000", 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0779999999999997e-06 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066031+0000", 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9249999999999995e-06 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066037+0000", 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.224e-06 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:245515 5.4 e52/17 ondisk, result = 0)", 2024-04-26T12:11:47.113 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.066030+0000", 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001351707, 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019880269999999998, 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066030+0000", 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066030+0000", 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066030+0000", 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066032+0000", 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066037+0000", 2024-04-26T12:11:47.115 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2050000000000001e-06 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066043+0000", 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8259999999999998e-06 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.067954+0000", 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019116700000000001 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.067962+0000", 2024-04-26T12:11:47.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4569999999999999e-06 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:245533 5.a e52/17 5:5ef506d9:::benchmark_data_smithi045_43640_object97159:head v 52'15274, mlcod=52'15270)", 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:47.066234+0000", 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0011471700000000001, 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018477459999999999, 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066234+0000", 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066234+0000", 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066234+0000", 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066239+0000", 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1989999999999997e-06 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066249+0000", 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6080000000000002e-06 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066254+0000", 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9429999999999997e-06 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066285+0000", 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0463999999999998e-05 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:47.066307+0000", 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1852999999999999e-05 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 10 2024-04-26T12:11:47.121 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:47.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:47.123 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:47.121+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.223 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:47.222+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.296 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:47.296 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:47.296 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:47.296 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:47.296 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:47.311 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:47.324 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:47.323+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.424 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:47.423+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.491 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:47.491 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:47.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:47.491 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.019922821999998, 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:47.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.497 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.018307579000002, 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:47.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:47.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:47.503 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.015943284000002, 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:47.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:47.509 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 58.101891971000001, 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:47.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 58.007212391000003, 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.516 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.517 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.517 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.517 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.517 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:47.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.517 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:47.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.521 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:47.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:47.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 58.002004620000001, 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:47.524 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.998805662000002, 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:47.530 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:47.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.998553854000001, 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.536 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:47.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:47.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:47.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.995897816000003, 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.542 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:47.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:47.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.547 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.994391047000001, 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:47.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.991780593999998, 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.553 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:47.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:47.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.558 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 50.145177935, 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.559 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:47.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.564 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.19371881, 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:47.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.441994999000002, 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:47.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.576 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.441886382, 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:47.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:47.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.441477839000001, 2024-04-26T12:11:47.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:47.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:47.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.436022678999997, 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.588 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 36.309303069999999, 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.594 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:47.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:47.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:47.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.703257340999997, 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.600 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.601 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.602 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.603 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.604 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 35.703097923000001, 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:47.605 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:47.606 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:47.607 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.608 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:47.609 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:47.610 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:47.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:47.612 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:47.611+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:47.712 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:47.711+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:47.813 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:47.812+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:47.816 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:47.816 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:47.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.816 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247684 5.3 5:c525c27a:::benchmark_data_smithi045_43640_object99310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.816 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.810121+0000", 2024-04-26T12:11:47.816 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0035138869999999998, 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0035360719999999999, 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247684 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810121+0000", 2024-04-26T12:11:47.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810121+0000", 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810120+0000", 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810126+0000", 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4519999999999996e-06 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810138+0000", 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1773999999999999e-05 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810146+0000", 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6249999999999996e-06 2024-04-26T12:11:47.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811014+0000", 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00086753299999999998 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811090+0000", 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6621999999999999e-05 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.821 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:247676 5.e e52/17 5:7c0aab82:::benchmark_data_smithi045_43640_object99302:head v 52'15512, mlcod=52'15510)", 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.810595+0000", 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.003039992, 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003107786, 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810595+0000", 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810595+0000", 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810594+0000", 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810601+0000", 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0090000000000001e-06 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810611+0000", 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0056e-05 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810618+0000", 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3729999999999998e-06 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810649+0000", 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1031000000000002e-05 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810668+0000", 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9547000000000001e-05 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:247679 5.4 e52/17 5:25354f37:::benchmark_data_smithi045_43640_object99305:head v 52'15624, mlcod=52'15622)", 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.810626+0000", 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0030094119999999999, 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00311232, 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.825 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810626+0000", 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810626+0000", 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810625+0000", 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810629+0000", 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4180000000000001e-06 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810635+0000", 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0329999999999997e-06 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810639+0000", 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8469999999999998e-06 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810669+0000", 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0315999999999999e-05 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810684+0000", 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4744e-05 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:247681 5.e e52/17 5:73a9af6a:::benchmark_data_smithi045_43640_object99307:head v 52'15513, mlcod=52'15510)", 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.810763+0000", 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0028726630000000001, 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0030338489999999999, 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810763+0000", 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810763+0000", 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810762+0000", 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810767+0000", 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4170000000000002e-06 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810773+0000", 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8820000000000003e-06 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810778+0000", 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9049999999999996e-06 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812664+0000", 2024-04-26T12:11:47.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018856960000000001 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812682+0000", 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7819e-05 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247685 5.6 5:6e53c3c3:::benchmark_data_smithi045_43640_object99311:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.811006+0000", 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.002629574, 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0028398590000000001, 2024-04-26T12:11:47.832 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247685 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811006+0000", 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811006+0000", 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811005+0000", 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811010+0000", 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5140000000000001e-06 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811021+0000", 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1001e-05 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.811030+0000", 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812655+0000", 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001625711 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812760+0000", 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104929 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:247687 5.0 e52/17 5:02ad280e:::benchmark_data_smithi045_43640_object99313:head v 52'15551, mlcod=52'15549)", 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.812430+0000", 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001205151, 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014534459999999999, 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812430+0000", 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812430+0000", 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812429+0000", 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812435+0000", 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9309999999999996e-06 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812443+0000", 2024-04-26T12:11:47.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9589999999999995e-06 2024-04-26T12:11:47.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812449+0000", 2024-04-26T12:11:47.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812788+0000", 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00033889800000000002 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812806+0000", 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7776000000000001e-05 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247688 5.3 5.b32abda3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.812574+0000", 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00106124, 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001342055, 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247688 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812574+0000", 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812574+0000", 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812573+0000", 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812578+0000", 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.276e-06 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812590+0000", 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2167999999999999e-05 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812598+0000", 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.0530000000000007e-06 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.845 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247670 5.a 5:5d12c461:::benchmark_data_smithi045_43640_object99296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.806696+0000", 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0069396299999999996, 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0072527110000000002, 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247670 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.846 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806696+0000", 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806696+0000", 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806694+0000", 2024-04-26T12:11:47.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999986 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806700+0000", 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3700000000000003e-06 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806710+0000", 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0563e-05 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806718+0000", 2024-04-26T12:11:47.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5889999999999997e-06 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806827+0000", 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010936499999999999 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.806950+0000", 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012291900000000001 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807066+0000", 2024-04-26T12:11:47.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000115513 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812667+0000", 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056013080000000002 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247672 5.2 5:4093b007:::benchmark_data_smithi045_43640_object99298:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.807871+0000", 2024-04-26T12:11:47.850 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0057644089999999999, 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061240019999999999, 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247672 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807871+0000", 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807871+0000", 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807870+0000", 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807875+0000", 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0189999999999997e-06 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807889+0000", 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.4327e-05 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807898+0000", 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4810000000000006e-06 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808603+0000", 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00070477400000000003 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808713+0000", 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000110918 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247673 5.5 5:a83294d0:::benchmark_data_smithi045_43640_object99299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.807912+0000", 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0057231929999999997, 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061198270000000004, 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.854 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247673 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807912+0000", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807912+0000", 2024-04-26T12:11:47.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807911+0000", 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807915+0000", 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1110000000000001e-06 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807925+0000", 2024-04-26T12:11:47.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2979999999999997e-06 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807931+0000", 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.173e-06 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.807966+0000", 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4789999999999997e-05 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808094+0000", 2024-04-26T12:11:47.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000127816 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247675 5.2 5:464719a2:::benchmark_data_smithi045_43640_object99301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.808108+0000", 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.005526782, 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059602270000000002, 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.858 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247675 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808108+0000", 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808108+0000", 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808108+0000", 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808112+0000", 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1919999999999998e-06 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808121+0000", 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2410000000000001e-06 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808128+0000", 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9249999999999998e-06 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812068+0000", 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0039400520000000003 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.812159+0000", 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1019000000000004e-05 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.861 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247677 5.6 5:62eef4d6:::benchmark_data_smithi045_43640_object99303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.808149+0000", 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0054860259999999997, 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0059945689999999999, 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247677 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.862 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808149+0000", 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808149+0000", 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808149+0000", 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:47.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808152+0000", 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0180000000000002e-06 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808159+0000", 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808164+0000", 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6250000000000004e-06 2024-04-26T12:11:47.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808204+0000", 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0278000000000003e-05 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808325+0000", 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012074399999999999 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.865 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:247680 5.6 5:6216d134:::benchmark_data_smithi045_43640_object99306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:47.866 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.808823+0000", 2024-04-26T12:11:47.866 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0048125909999999997, 2024-04-26T12:11:47.866 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054209990000000001, 2024-04-26T12:11:47.866 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:47.866 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 247680 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808823+0000", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808823+0000", 2024-04-26T12:11:47.867 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808822+0000", 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808827+0000", 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7180000000000004e-06 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:47.868 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808835+0000", 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6600000000000001e-06 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.808842+0000", 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.759e-06 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810279+0000", 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0014373140000000001 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:47.869 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.810361+0000", 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1859000000000003e-05 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:11:47.870 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:47.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:47.879 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:47.880 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:47.880 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:47.882 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:47.883 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:47.914 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:47.912+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.015 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:48.014+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.106 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:48.106 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:48.115 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:48.114+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:48.125 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:48.217 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:48.216+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:11:48.318 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:48.317+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:48.355 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:48.355 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:48.370 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:48.419 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:48.418+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.520 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:48.519+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.554 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:48.555 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:48.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:48.620 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:48.619+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:48.722 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:48.720+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:48.793 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:48.793 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:48.808 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:48.857 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:48.856+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.923 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:48.922+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:48.997 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:48.997 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:49.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:49.054 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:49.053+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:49.127 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:49.125+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:49.211 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:49.212 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:49.227 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:49.226+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:49.228 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:11:49.327 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:49.327+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:49.428 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:49.427+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:49.438 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:49.438 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:49.450 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:49.530 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:49.529+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:49.631 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:49.630+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:49.711 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:49.757 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:49.755+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:49.834 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:49.832+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:49.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:49.889 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:49.890 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:49.903 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:49.944 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:49.943+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:50.035 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:50.034+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:50.063 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:50.084 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:50.087 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:50.089 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:50.120 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:50.120 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:50.120 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:50.120 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:50.121 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:50.136 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:50.177 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:50.176+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:50.242 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:50.237+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:50.338 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:50.337+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:50.354 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 64.882186579000006, 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:50.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 64.880571336000003, 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.360 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:50.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:50.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 64.878207040999996, 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.366 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:50.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:50.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:50.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.964155728000001, 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:50.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.377 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.869476147999997, 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.378 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.864268377000002, 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:50.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:50.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:50.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:50.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.861069419000003, 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:50.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:50.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:50.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:50.397 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.860817611000002, 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:50.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.403 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.858161572999997, 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:50.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.409 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.856654804000001, 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.410 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:50.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:50.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:50.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:50.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 60.854044350999999, 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.417 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:50.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:50.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:50.422 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 53.007441692, 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:50.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:50.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.055982567000001, 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.429 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:50.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:50.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.304258756000003, 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.435 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:50.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:50.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:50.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.304150139000001, 2024-04-26T12:11:50.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:50.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:50.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:50.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.303741596000002, 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:50.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.298286435999998, 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.453 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:50.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.458 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 39.171566826999999, 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:50.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.565521097999998, 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:50.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 38.565361680000002, 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.470 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:50.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:50.472 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:50.473 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:50.474 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:50.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.475 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:50.475 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:50.475 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:50.476 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:50.475+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:50.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:50.577 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:50.576+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:50.678 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:50.677+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:50.679 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:50.679 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255770 5.6 5:6c95ec83:::benchmark_data_smithi045_43640_object107396:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.673965+0000", 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0019111379999999999, 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00193736, 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.680 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255770 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673965+0000", 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673965+0000", 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673964+0000", 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673969+0000", 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0590000000000002e-06 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673979+0000", 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7110000000000007e-06 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673986+0000", 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7039999999999994e-06 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674110+0000", 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000124151 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674240+0000", 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012982799999999999 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675858+0000", 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016181100000000001 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675899+0000", 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0998000000000003e-05 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255771 5.2 5.a298c622 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.684 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.674049+0000", 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001826837, 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001961576, 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255771 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674049+0000", 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674049+0000", 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674049+0000", 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674052+0000", 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0910000000000001e-06 2024-04-26T12:11:50.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674057+0000", 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1100000000000002e-06 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674061+0000", 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8670000000000004e-06 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.687 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop_reply(client.4719.0:255754 5.a e53/17)", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.674778+0000", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001098028, 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001289519, 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674778+0000", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674778+0000", 2024-04-26T12:11:50.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674777+0000", 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674782+0000", 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2710000000000003e-06 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674792+0000", 2024-04-26T12:11:50.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9140000000000003e-06 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674797+0000", 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3020000000000002e-06 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255774 5.7 5:e46c8ea1:::benchmark_data_smithi045_43640_object107400:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.675673+0000", 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000202895, 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00045282200000000002, 2024-04-26T12:11:50.690 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255774 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675673+0000", 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675673+0000", 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675672+0000", 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675677+0000", 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675684+0000", 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675689+0000", 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0900000000000004e-06 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675725+0000", 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5985999999999997e-05 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675854+0000", 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012889100000000001 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255777 5.a 5.42136d4a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.675954+0000", 2024-04-26T12:11:50.694 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999223, 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00026225800000000002, 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255777 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675954+0000", 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675954+0000", 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675953+0000", 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675957+0000", 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5090000000000004e-06 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675966+0000", 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7830000000000004e-06 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675973+0000", 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.007e-06 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255779 5.c 5:3fb0b6d7:::benchmark_data_smithi045_43640_object107405:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.697 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.676170+0000", 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9997063, 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1792999999999993e-05, 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "reached pg", 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255779 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676170+0000", 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676170+0000", 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676169+0000", 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676174+0000", 2024-04-26T12:11:50.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2660000000000001e-06 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676185+0000", 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1287000000000001e-05 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676193+0000", 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6869999999999994e-06 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.676237+0000", 2024-04-26T12:11:50.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3912999999999998e-05 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255743 5.a 5:5d6ee17b:::benchmark_data_smithi045_43640_object107369:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.663613+0000", 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.012263372999999999, 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012687317, 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.701 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255743 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.663613+0000", 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.663613+0000", 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.663612+0000", 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.663617+0000", 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2190000000000003e-06 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.663626+0000", 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7730000000000005e-06 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.663633+0000", 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0960000000000003e-06 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.667892+0000", 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004259405 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668020+0000", 2024-04-26T12:11:50.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012756599999999999 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668135+0000", 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114879 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.671794+0000", 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0036593379999999998 2024-04-26T12:11:50.705 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255747 5.2 5:49ad274b:::benchmark_data_smithi045_43640_object107373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.664552+0000", 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.01132411, 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011811944, 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255747 2024-04-26T12:11:50.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.664552+0000", 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.664552+0000", 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.664551+0000", 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.664555+0000", 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2339999999999996e-06 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.664564+0000", 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0100000000000001e-06 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.708 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.664571+0000", 2024-04-26T12:11:50.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2439999999999998e-06 2024-04-26T12:11:50.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.670217+0000", 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056459639999999998 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:50.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.670358+0000", 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000141371 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255754 5.a 5:54a6a170:::benchmark_data_smithi045_43640_object107380:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.712 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.666525+0000", 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0093514099999999992, 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0098839140000000006, 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.713 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255754 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.666525+0000", 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.715 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.666525+0000", 2024-04-26T12:11:50.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.666524+0000", 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.716 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.666528+0000", 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5549999999999998e-06 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.666534+0000", 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.717 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.666539+0000", 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8250000000000004e-06 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.672772+0000", 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.006232502 2024-04-26T12:11:50.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.672915+0000", 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000143542 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.673090+0000", 2024-04-26T12:11:50.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000174928 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:255755 5.a 5:590338cc:::benchmark_data_smithi045_43640_object107381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:50.668054+0000", 2024-04-26T12:11:50.720 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0078219250000000004, 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0084170789999999992, 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 255755 2024-04-26T12:11:50.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668054+0000", 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.722 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668054+0000", 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668053+0000", 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668058+0000", 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8590000000000004e-06 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668067+0000", 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:11:50.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.668075+0000", 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6120000000000001e-06 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.674959+0000", 2024-04-26T12:11:50.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0068840660000000003 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675104+0000", 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014519000000000001 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:50.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:50.675223+0000", 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000119113 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 10 2024-04-26T12:11:50.727 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:50.729 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:50.779 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:50.778+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:50.880 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:50.879+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:50.967 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:50.967 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:50.967 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:50.967 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:50.967 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:50.981 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:50.983 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:50.982+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:51.084 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:51.083+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:51.177 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:51.177 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:51.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:51.178 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:51.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.178 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:51.178 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:51.178 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.922680138000004, 2024-04-26T12:11:51.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:51.179 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.179 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.179 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.179 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.179 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.179 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:51.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:51.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.183 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.183 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:51.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:51.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:51.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:51.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:51.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:51.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:51.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:51.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 71.196876868999993, 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.190 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:51.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:51.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:51.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:51.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.197 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 65.705687838000003, 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.198 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:51.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.203 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.203 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:51.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:51.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:51.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:51.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:51.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.206 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 65.703336461999996, 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.207 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.208 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:51.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:51.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.212 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.690238178999998, 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.213 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:51.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:51.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.218 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.686983202, 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:51.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.224 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:51.224 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:51.224 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.684485527, 2024-04-26T12:11:51.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:51.225 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.225 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.225 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.225 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.225 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.225 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:51.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:51.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:51.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:51.231 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.683802225999997, 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:51.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:51.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:51.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:51.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:51.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:51.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:51.240 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.681681709999999, 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:51.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 61.679467699, 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.245 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.246 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:51.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 53.998968144000003, 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.251 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:51.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:51.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 43.908076323000003, 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.256 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.260 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.125320913000003, 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:51.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:51.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.123542487000002, 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:51.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:51.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:51.272 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.121018292999999, 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:51.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.274 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:51.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:51.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.140749816, 2024-04-26T12:11:51.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:51.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.286251951000001, 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:51.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:51.287 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:51.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.289 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:51.290 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217992 5.2 5:408cc078:::benchmark_data_smithi045_43640_object69618:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.901434097999999, 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021913996000000002, 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.293 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217992 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:51.294 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.295 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272223+0000", 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1660000000000001e-06 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272229+0000", 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:11:51.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272233+0000", 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.967e-06 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283739+0000", 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011505319999999999 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.297 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283901+0000", 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000161991 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294047+0000", 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010145972 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294081+0000", 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.298 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294135+0000", 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4085000000000001e-05 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 13.89912299, 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.299 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.301 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.302 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:11:51.303 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:246008 5.2 5:456ba372:::benchmark_data_smithi045_43640_object97634:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:51.305 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 3.950941743, 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020967903, 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 246008 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222716+0000", 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6089999999999999e-06 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222722+0000", 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1299999999999998e-06 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222729+0000", 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1999999999999997e-06 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.227390+0000", 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046610109999999996 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.227520+0000", 2024-04-26T12:11:51.309 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013021300000000001 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.243556+0000", 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016036170999999998 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.243605+0000", 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8346000000000001e-05 2024-04-26T12:11:51.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.243681+0000", 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6650999999999995e-05 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.312 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:51.312 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:51.312 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:51.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:11:51.314 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:51.312+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:51.314 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:51.414 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:51.413+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:51.498 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:51.498 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:51.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.498 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:258038 5.4 5:21d6baea:::benchmark_data_smithi045_43640_object109664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:51.498 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.495516+0000", 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00083812299999999997, 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00086230499999999995, 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 258038 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495516+0000", 2024-04-26T12:11:51.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495516+0000", 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495515+0000", 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495520+0000", 2024-04-26T12:11:51.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9579999999999998e-06 2024-04-26T12:11:51.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495531+0000", 2024-04-26T12:11:51.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1168999999999999e-05 2024-04-26T12:11:51.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495539+0000", 2024-04-26T12:11:51.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1899999999999998e-06 2024-04-26T12:11:51.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495577+0000", 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8065999999999998e-05 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495687+0000", 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010986500000000001 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495786+0000", 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9752000000000003e-05 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:258037 5.a e53/17 5:5b27be0d:::benchmark_data_smithi045_43640_object109663:head v 53'16042, mlcod=53'16040)", 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.495520+0000", 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00083450099999999997, 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00095589999999999998, 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495520+0000", 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495520+0000", 2024-04-26T12:11:51.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495519+0000", 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495525+0000", 2024-04-26T12:11:51.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0120000000000002e-06 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495533+0000", 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2430000000000005e-06 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495539+0000", 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5849999999999999e-06 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495569+0000", 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0141000000000002e-05 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495590+0000", 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0468000000000001e-05 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:258039 5.f 5:f7834212:::benchmark_data_smithi045_43640_object109665:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.495551+0000", 2024-04-26T12:11:51.510 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00080294399999999999, 2024-04-26T12:11:51.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00098963299999999996, 2024-04-26T12:11:51.511 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.511 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:51.511 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:51.511 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:51.511 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 258039 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495551+0000", 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495551+0000", 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495551+0000", 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495554+0000", 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6769999999999999e-06 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495559+0000", 2024-04-26T12:11:51.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.728e-06 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495565+0000", 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7599999999999999e-06 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495601+0000", 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5732999999999998e-05 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.495713+0000", 2024-04-26T12:11:51.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011176299999999999 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:258041 5.8 5:199e45c0:::benchmark_data_smithi045_43640_object109667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.496139+0000", 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00021549000000000001, 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00046984099999999998, 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:51.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 258041 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496139+0000", 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496139+0000", 2024-04-26T12:11:51.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496138+0000", 2024-04-26T12:11:51.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496143+0000", 2024-04-26T12:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7360000000000001e-06 2024-04-26T12:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496152+0000", 2024-04-26T12:11:51.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5170000000000005e-06 2024-04-26T12:11:51.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496160+0000", 2024-04-26T12:11:51.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5310000000000004e-06 2024-04-26T12:11:51.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496198+0000", 2024-04-26T12:11:51.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7832e-05 2024-04-26T12:11:51.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496316+0000", 2024-04-26T12:11:51.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117821 2024-04-26T12:11:51.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496393+0000", 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7888999999999999e-05 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:258042 5.d 5:bcf75675:::benchmark_data_smithi045_43640_object109668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.496487+0000", 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9998674, 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000198839, 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:51.531 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 258042 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496487+0000", 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.532 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496487+0000", 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496486+0000", 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496491+0000", 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9239999999999998e-06 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496502+0000", 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0494e-05 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496510+0000", 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2330000000000006e-06 2024-04-26T12:11:51.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496554+0000", 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4326999999999998e-05 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.496688+0000", 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000133631 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.538 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:258031 5.d 5:b5dd71af:::benchmark_data_smithi045_43640_object109657:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:51.538 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.493380+0000", 2024-04-26T12:11:51.538 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0029742000000000002, 2024-04-26T12:11:51.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003373058, 2024-04-26T12:11:51.538 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 258031 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.493380+0000", 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.493380+0000", 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.493379+0000", 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.493384+0000", 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.51e-06 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.493392+0000", 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.493398+0000", 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0109999999999997e-06 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494896+0000", 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001497764 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494992+0000", 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5472999999999999e-05 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:258034 5.8 5:16b7d186:::benchmark_data_smithi045_43640_object109660:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:51.494150+0000", 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0022044650000000001, 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0026722479999999999, 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:51.542 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 258034 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494150+0000", 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494150+0000", 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:51.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494149+0000", 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494154+0000", 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.442e-06 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494162+0000", 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4130000000000006e-06 2024-04-26T12:11:51.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494167+0000", 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1789999999999999e-06 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494197+0000", 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.932e-05 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494271+0000", 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4894000000000005e-05 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:51.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:51.494336+0000", 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.4301000000000007e-05 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 7 2024-04-26T12:11:51.547 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:51.550 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:51.550 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:51.547+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:51.650 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:51.649+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:51.751 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:51.749+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:51.768 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:51.768 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:51.768 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:51.768 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:51.769 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:51.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:51.852 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:51.850+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:51.952 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:51.950+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:52.009 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.536729640999994, 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.016 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.535114398000005, 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.017 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.019 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:52.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.019 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:52.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:52.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:52.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:52.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:52.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:52.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:52.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:52.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:52.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:52.028 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:52.029 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.029 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.029 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.029 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:52.029 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.532750102999998, 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:52.031 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.032 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.032 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.032 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.032 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.032 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:52.032 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.033 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.033 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.034 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.034 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:52.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.034 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.035 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.035 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:52.035 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.035 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.035 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.036 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:52.036 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.036 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.036 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:52.037 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:52.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.038 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.038 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.038 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:52.038 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:52.038 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.039 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:52.040 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:52.040 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.040 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.040 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:52.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.042 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.042 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.042 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:52.042 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:52.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.043 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.043 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:52.043 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:52.043 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.043 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.045 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.045 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.045 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:52.045 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.618698790000003, 2024-04-26T12:11:52.046 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:52.046 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.046 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.046 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.047 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:52.048 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.048 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.048 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.048 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.049 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.050 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.050 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:52.050 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:52.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.050 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.051 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:52.052 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:52.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.052 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.052 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:52.053 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:52.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.053 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.053 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.053 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:52.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:52.054 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.054 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.054 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.054 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:52.054 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:52.055 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.056 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.057 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.057 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.057 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.057 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.524019209999999, 2024-04-26T12:11:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.058 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.059 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.061 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.062 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:52.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:52.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.063 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.063 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.063 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:52.063 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:52.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.064 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.064 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.064 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:52.065 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.067 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:52.067 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:52.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.067 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.067 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.068 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:52.068 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:52.068 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.068 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.068 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.068 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.069 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.069 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.070 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:52.070 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.518811438999997, 2024-04-26T12:11:52.070 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:52.070 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.070 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.070 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.071 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.071 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.071 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:52.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.072 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.072 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.072 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.072 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:52.073 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.073 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.073 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.073 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.074 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:52.074 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.074 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.074 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.075 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:52.075 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.075 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.075 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.075 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:52.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:52.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.077 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.077 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.077 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:52.077 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:52.078 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.078 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.078 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.078 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:52.078 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:52.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.079 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.079 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.079 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:52.079 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:52.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.080 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.080 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:52.080 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:52.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.080 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:52.081 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.082 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.083 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.083 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:52.083 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:52.083 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.083 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.083 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.515612480999998, 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.084 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.085 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.086 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:52.087 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.088 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.089 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.090 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:52.090 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:52.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.090 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:52.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.092 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.515360673000004, 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.094 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:52.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:52.096 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.097 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.098 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.098 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:52.098 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:52.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.098 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.099 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.100 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.512704634999999, 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.101 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.103 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.103 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.103 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:52.103 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.104 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.104 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.104 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:52.104 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.105 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.106 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:52.106 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:52.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.106 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.106 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.107 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:52.107 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:52.107 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.107 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.108 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:52.108 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:52.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.108 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:52.109 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:52.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.110 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.110 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.110 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:52.110 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:52.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.111 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:52.112 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:52.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.112 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.112 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.112 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.113 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.114 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:52.114 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.511197866000003, 2024-04-26T12:11:52.114 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:52.114 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.114 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.114 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.115 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.116 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:52.116 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.116 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.116 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:52.117 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.117 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.117 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.117 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.117 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:52.118 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:52.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.118 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.118 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.118 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:52.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:52.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.119 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.119 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.119 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:52.119 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:52.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.120 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.120 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.120 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:52.120 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:52.120 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.121 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.121 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.121 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:52.121 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:52.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.122 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.122 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.122 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:52.122 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:52.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.123 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.123 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:52.123 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:52.123 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.123 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.124 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:52.124 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:52.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.124 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.124 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.125 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:52.125 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:52.125 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.125 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.126 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:52.126 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:52.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.126 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.126 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.127 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:52.127 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:52.127 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.127 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.127 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 62.508587413000001, 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.128 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.129 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.129 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.129 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.129 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:52.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.129 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.130 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.132 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.133 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.134 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 54.661984754000002, 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.135 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.136 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:52.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.138 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.139 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.710525629000003, 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.141 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.143 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:52.147 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:52.148 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.149 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.150 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.958801817999998, 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.151 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.152 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.153 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:52.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:52.155 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.156 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.157 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.958693201000003, 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.158 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.159 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.160 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:52.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.162 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.163 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.958284657999997, 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.164 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.165 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.167 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.168 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.169 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.952829498, 2024-04-26T12:11:52.170 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:52.171 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.171 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.171 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.171 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.171 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.171 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:52.172 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.172 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.172 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.172 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.172 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:52.172 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.173 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:52.174 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:52.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.826109889000001, 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.178 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.179 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.180 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.181 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:52.182 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.22006416, 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.183 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.184 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.185 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:52.186 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:52.186 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.186 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:52.188 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:52.186+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:52.188 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.188 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:52.188 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:52.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:52.189 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.190 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 40.219904741999997, 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:52.191 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:52.192 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:52.193 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:52.194 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:52.195 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:52.196 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:52.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:52.240 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:11:52.288 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:52.287+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:52.361 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:52.391 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:52.393 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:52.394 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:52.394 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:52.395 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:52.395 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:52.396 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:52.392+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:52.413 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:52.492 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:52.491+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:52.593 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:52.592+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:52.653 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:52.653 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:52.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:52.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-04-26T12:11:52.714 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:52.713+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:52.794 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:52.793+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:52.879 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:52.879 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:52.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:52.931 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:52.930+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:52.998 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:52.997+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:53.074 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:53.074 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:53.086 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:53.097 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:53.096+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:53.199 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:53.198+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:53.300 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:53.299+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:53.304 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:53.304 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:53.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:53.403 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:53.402+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:53.503 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:53.501+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:53.531 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:53.532 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:53.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:53.606 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:53.604+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:53.705 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:53.704+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:53.748 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:53.748 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:53.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:53.806 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:53.804+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:53.915 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:53.913+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:53.965 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:53.965 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:53.982 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:54.010 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.009+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.111 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:54.109+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:54.212 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.211+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.221 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:54.221 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:54.238 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:54.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:11:54.314 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.312+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:54.415 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.414+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.423 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:54.423 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:54.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:54.516 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:54.514+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:54.565 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:54.586 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:54.587 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:54.587 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:54.587 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:54.589 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:54.590 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:54.616 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.615+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.659 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:54.659 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:54.659 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:54.675 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:54.718 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.716+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.818 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:54.817+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.428861222999998, 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:54.901 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.902 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.903 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.903 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.903 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:54.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:54.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:54.909 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.427245979999995, 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:54.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:54.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:54.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:54.915 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.424881685000003, 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:54.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:54.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:54.920 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.510830372000001, 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:54.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:54.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:54.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:54.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:54.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.416150791999996, 2024-04-26T12:11:54.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.931 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.410943020999994, 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.407744062999996, 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.937 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.407492254999994, 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:54.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:54.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:54.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:54.947 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.404836216999996, 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:54.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:54.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:54.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:54.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96955 5.8 5:1810e2e5:::benchmark_data_smithi045_43640_object96954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.403329447999994, 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020728785999999999, 2024-04-26T12:11:54.953 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96955 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493879+0000", 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493878+0000", 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493943+0000", 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.5031999999999997e-05 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493952+0000", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493957+0000", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495406+0000", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0014490320000000001 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495573+0000", 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000166553 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495714+0000", 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000141326 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.497479+0000", 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001764984 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514528+0000", 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.017048471999999999 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514573+0000", 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4835e-05 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.514607+0000", 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4792000000000002e-05 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 65.400718995000005, 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.554116336, 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.964 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:54.969 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 52.602657211, 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.974 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.850933400000002, 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.850824783, 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.980 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:54.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.985 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.850416240000001, 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.986 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.844961079999997, 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.991 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:54.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:54.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:54.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.718241470999999, 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:54.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:54.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:54.999 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:55.000 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:55.001 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.112195741999997, 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:55.002 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.003 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.004 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.006 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 43.112036324000002, 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.007 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:55.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.010 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:55.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:55.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:55.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:55.014 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:55.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:55.016 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:55.014+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:55.117 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:55.114+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:55.218 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:55.216+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:268561 5.4 e54/17 5:21c1f88e:::benchmark_data_smithi045_43640_object120187:head v 54'16954, mlcod=54'16952)", 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.219829+0000", 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.004654287, 2024-04-26T12:11:55.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046804309999999997, 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219829+0000", 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219829+0000", 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219829+0000", 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219834+0000", 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0150000000000003e-06 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219841+0000", 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4780000000000002e-06 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219846+0000", 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6659999999999999e-06 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219881+0000", 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.219895+0000", 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3794999999999999e-05 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:268562 5.1 5:82d4c288:::benchmark_data_smithi045_43640_object120188:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.220219+0000", 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0042643200000000003, 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043655650000000001, 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 268562 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220219+0000", 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220219+0000", 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220218+0000", 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220223+0000", 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8180000000000003e-06 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220239+0000", 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5364000000000001e-05 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220246+0000", 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3629999999999996e-06 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220280+0000", 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4493999999999999e-05 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.220394+0000", 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113285 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.238 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:268567 5.4 e54/17 5:2620c4c2:::benchmark_data_smithi045_43640_object120193:head v 54'16955, mlcod=54'16952)", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.222490+0000", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001993514, 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021677939999999998, 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222490+0000", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222490+0000", 2024-04-26T12:11:55.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222490+0000", 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222495+0000", 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0359999999999997e-06 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222504+0000", 2024-04-26T12:11:55.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.4399999999999994e-06 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222510+0000", 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8379999999999998e-06 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222550+0000", 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9612e-05 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222568+0000", 2024-04-26T12:11:55.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8332e-05 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:268570 5.c 5:3128f637:::benchmark_data_smithi045_43640_object120196:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.222807+0000", 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0016771679999999999, 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001922586, 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.242 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 268570 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222807+0000", 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222807+0000", 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222805+0000", 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222812+0000", 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1360000000000002e-06 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222819+0000", 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5939999999999996e-06 2024-04-26T12:11:55.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222824+0000", 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2059999999999998e-06 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222861+0000", 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7057000000000001e-05 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223003+0000", 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000141216 2024-04-26T12:11:55.245 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:268573 5.1 5:8cc949f2:::benchmark_data_smithi045_43640_object120199:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.222964+0000", 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001519371, 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018445720000000001, 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 268573 2024-04-26T12:11:55.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222964+0000", 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222964+0000", 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.247 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222964+0000", 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222968+0000", 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222982+0000", 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.3838e-05 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.248 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.222990+0000", 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5730000000000002e-06 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223030+0000", 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0503999999999997e-05 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223151+0000", 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012019300000000001 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:268572 5.0 e54/17 5:025e95f3:::benchmark_data_smithi045_43640_object120198:head v 54'16812, mlcod=54'16810)", 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.223188+0000", 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0012952619999999999, 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001688298, 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.250 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223188+0000", 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223188+0000", 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.251 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223188+0000", 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223194+0000", 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8810000000000001e-06 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223202+0000", 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.5580000000000001e-06 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223209+0000", 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4489999999999996e-06 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223261+0000", 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2333999999999997e-05 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.223282+0000", 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0438999999999999e-05 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.253 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:268575 5.7 5:eea1119a:::benchmark_data_smithi045_43640_object120201:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:55.224764+0000", 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9997196, 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00017760900000000001, 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 268575 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.254 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224764+0000", 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224764+0000", 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224763+0000", 2024-04-26T12:11:55.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224768+0000", 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4249999999999997e-06 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224779+0000", 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.111e-05 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224787+0000", 2024-04-26T12:11:55.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2060000000000001e-06 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224824+0000", 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7734999999999997e-05 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:55.224941+0000", 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000116827 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.257 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:55.258 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 7 2024-04-26T12:11:55.258 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:11:55.259 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:55.319 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:55.318+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:55.423 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:55.422+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:55.509 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:55.509 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:55.509 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:55.509 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:55.509 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:55.518 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:55.524 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:55.523+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:55.629 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:55.627+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:55.721 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:55.721 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:11:55.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:11:55.721 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:55.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:67495 5.a 5:52d7f2e4:::benchmark_data_smithi045_43640_object67494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.467037969000003, 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021254611999999999, 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 67495 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250975+0000", 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.250974+0000", 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251098+0000", 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012316599999999999 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251106+0000", 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.251113+0000", 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.7669999999999998e-06 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.261938+0000", 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010825273 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262078+0000", 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000139911 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.262236+0000", 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00015810499999999999 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.264325+0000", 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020885389999999999 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.726 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272129+0000", 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078045220000000004 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272185+0000", 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5714999999999998e-05 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:35.272230+0000", 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4501e-05 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.741234700000007, 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.728 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.729 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:11:55.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:11:55.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:11:55.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.250045669000002, 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:11:55.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.735 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:11:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:11:55.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.738 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.739 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.247694292999995, 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.740 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:11:55.742 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:11:55.743 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.744 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.234596010000004, 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:11:55.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.747 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.748 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.231341033000007, 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:11:55.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:11:55.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.228843358000006, 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.753 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.754 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.228160056999997, 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:11:55.762 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.226039541000006, 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:55.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:11:55.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:11:55.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96950 5.e e33/17 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head v 33'6087, mlcod=33'6081)", 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 66.223825529999999, 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021312580000000001, 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494187+0000", 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494238+0000", 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1196000000000002e-05 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.768 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494250+0000", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1491000000000001e-05 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.494255+0000", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9540000000000001e-06 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506888+0000", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.012632592 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.506915+0000", 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6798e-05 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515481+0000", 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0085658120000000008 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515500+0000", 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9338999999999999e-05 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.770 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:114213 5.6 5:6fb3c3d0:::benchmark_data_smithi045_43640_object114212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 58.543325975000002, 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021607622, 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 114213 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174687+0000", 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174686+0000", 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174795+0000", 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108194 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174804+0000", 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.9150000000000008e-06 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.174811+0000", 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1929999999999998e-06 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185020+0000", 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.01020911 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.185170+0000", 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000150192 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196181+0000", 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011010689000000001 2024-04-26T12:11:55.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196234+0000", 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3140999999999998e-05 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:57.196295+0000", 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0850000000000002e-05 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.775 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:136566 5.7 5:eb68161f:::benchmark_data_smithi045_43640_object136565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.452434154000002, 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021232001, 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 136566 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265579+0000", 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265578+0000", 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265603+0000", 2024-04-26T12:11:55.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5137999999999999e-05 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265608+0000", 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4989999999999996e-06 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.265612+0000", 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.783e-06 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.778 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271301+0000", 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056892319999999998 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.271446+0000", 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000145069 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286720+0000", 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015274045 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286768+0000", 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7673999999999998e-05 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:07.286811+0000", 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3124000000000002e-05 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144968 5.4 e40/17 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head v 40'9137, mlcod=40'9135)", 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:55.780 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 44.669678744000002, 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021013759999999999, 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048334+0000", 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048333+0000", 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048371+0000", 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7802000000000002e-05 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048382+0000", 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1035e-05 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.048389+0000", 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050733+0000", 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002343908 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.783 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050759+0000", 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5836000000000001e-05 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069308+0000", 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.018549517000000001 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.069348+0000", 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9814000000000002e-05 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144976 5.4 e40/17 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head v 40'9139, mlcod=40'9135)", 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 44.667900318000001, 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021282702000000001, 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050113+0000", 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050112+0000", 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050143+0000", 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.1359000000000002e-05 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050152+0000", 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2949999999999994e-06 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.050157+0000", 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065175+0000", 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.015018269000000001 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.065198+0000", 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2963e-05 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071362+0000", 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0061637760000000002 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.071395+0000", 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.788 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 44.665376123999998, 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:11:55.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:11:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:11:55.792 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.685107647000002, 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.793 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.797 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 26.830609782, 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.798 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:11:55.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.802 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217992 5.2 5:408cc078:::benchmark_data_smithi045_43640_object69618:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.445791928999999, 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.021913996000000002, 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.803 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217992 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272221+0000", 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272223+0000", 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.1660000000000001e-06 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272229+0000", 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.272233+0000", 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.967e-06 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283739+0000", 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011505319999999999 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.283901+0000", 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000161991 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294047+0000", 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.010145972 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294081+0000", 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.294135+0000", 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4085000000000001e-05 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 18.443480821000001, 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.808 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:11:55.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:11:55.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:11:55.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.813 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:246008 5.2 5:456ba372:::benchmark_data_smithi045_43640_object97634:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.4952995740000006, 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.020967903, 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 246008 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:55.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222713+0000", 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:55.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222716+0000", 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6089999999999999e-06 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222722+0000", 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1299999999999998e-06 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.222729+0000", 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1999999999999997e-06 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.227390+0000", 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0046610109999999996 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.227520+0000", 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013021300000000001 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.243556+0000", 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016036170999999998 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.243605+0000", 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8346000000000001e-05 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:47.243681+0000", 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6650999999999995e-05 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:55.818 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:55.820 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:55.820 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:55.818+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:55.920 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:55.918+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:56.004 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:56.004 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:270724 5.4 5:2eb42316:::benchmark_data_smithi045_43640_object122350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:55.997940+0000", 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.005779307, 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0057973779999999997, 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 270724 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.005 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.997940+0000", 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.997940+0000", 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.997940+0000", 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.006 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.997944+0000", 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6439999999999999e-06 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.997954+0000", 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.594e-06 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.997961+0000", 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.306e-06 2024-04-26T12:11:56.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.998012+0000", 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0504000000000003e-05 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.998130+0000", 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011811000000000001 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.998252+0000", 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012222900000000001 2024-04-26T12:11:56.008 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002246+0000", 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039936169999999997 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:270729 5.4 5:2ce25cc7:::benchmark_data_smithi045_43640_object122355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:56.000416+0000", 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0033033699999999999, 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0033760109999999999, 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.009 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:56.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.010 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.010 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 270729 2024-04-26T12:11:56.010 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000416+0000", 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.011 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000416+0000", 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000415+0000", 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.012 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000421+0000", 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.344e-06 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000431+0000", 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0317e-05 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.013 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000439+0000", 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8690000000000004e-06 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000495+0000", 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5699999999999999e-05 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000626+0000", 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013121699999999999 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.014 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.000746+0000", 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119604 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002374+0000", 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0016283370000000001 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:270734 5.a e55/17 5:5a8bddbe:::benchmark_data_smithi045_43640_object122360:head v 55'16766, mlcod=55'16764)", 2024-04-26T12:11:56.015 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:56.002615+0000", 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0011049, 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0012299920000000001, 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002615+0000", 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002615+0000", 2024-04-26T12:11:56.016 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002614+0000", 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002620+0000", 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002629+0000", 2024-04-26T12:11:56.017 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8810000000000002e-06 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002634+0000", 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.3519999999999997e-06 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002670+0000", 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5209000000000001e-05 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.002690+0000", 2024-04-26T12:11:56.018 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0667999999999999e-05 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:270736 5.f 5:fc19361a:::benchmark_data_smithi045_43640_object122362:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:56.003132+0000", 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00058763000000000001, 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00074663400000000003, 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.019 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 270736 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003132+0000", 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003132+0000", 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.020 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003131+0000", 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.021 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003135+0000", 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0080000000000004e-06 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003143+0000", 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.114e-06 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003148+0000", 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4e-06 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.022 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003175+0000", 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6676999999999999e-05 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003253+0000", 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8533000000000002e-05 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:270738 5.b 5:dbd55ba3:::benchmark_data_smithi045_43640_object122364:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:11:56.023 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:56.003268+0000", 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.000451867, 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00064890599999999998, 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 270738 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003268+0000", 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.024 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003268+0000", 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003267+0000", 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003270+0000", 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0089999999999999e-06 2024-04-26T12:11:56.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003275+0000", 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.8280000000000002e-06 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003280+0000", 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4139999999999996e-06 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003313+0000", 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3430999999999999e-05 2024-04-26T12:11:56.026 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003425+0000", 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000111606 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.027 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:56.003526+0000", 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010149099999999999 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 5 2024-04-26T12:11:56.034 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:56.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:56.036 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:56.034+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:56.136 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:56.134+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:56.238 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:56.237+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:56.253 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:56.253 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:56.254 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:56.254 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:56.254 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:56.268 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:56.353 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:56.352+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:56.443 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:56.441+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.490 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.017739453999994, 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.491 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.492 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.494 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.495 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:56.496 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.016124211000005, 2024-04-26T12:11:56.497 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.500 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.500 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:56.500 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.501 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.502 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.503 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87786 5.4 5:240f7b47:::benchmark_data_smithi045_43640_object87785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.013759915999998, 2024-04-26T12:11:56.504 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020902205, 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87786 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.505 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472326+0000", 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472510+0000", 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00018449499999999999 2024-04-26T12:11:56.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472518+0000", 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1219999999999995e-06 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.472525+0000", 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473418+0000", 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00089379800000000001 2024-04-26T12:11:56.507 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473537+0000", 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011858699999999999 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473701+0000", 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00016382899999999999 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.477208+0000", 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003506777 2024-04-26T12:11:56.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493187+0000", 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.015979607 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493209+0000", 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1902000000000001e-05 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493229+0000", 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9386e-05 2024-04-26T12:11:56.509 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 67.099708602999996, 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.510 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.511 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:56.512 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:56.513 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:56.514 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 67.005029023000006, 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:56.515 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.516 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.517 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.518 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.519 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.520 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.999821252000004, 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.521 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.522 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.523 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.524 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.525 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.996622294000005, 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.526 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.528 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.529 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.530 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.531 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.996370486000004, 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.532 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.533 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:56.534 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:56.535 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:56.536 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.993714448000006, 2024-04-26T12:11:56.537 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.538 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.539 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.540 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.541 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.542 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96958 5.e 5:78183e78:::benchmark_data_smithi045_43640_object96957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 66.989597226000001, 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023029676999999998, 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96958 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.543 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496489+0000", 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496488+0000", 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.544 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496563+0000", 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5164000000000001e-05 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496572+0000", 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.5960000000000004e-06 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496578+0000", 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3520000000000003e-06 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.545 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496617+0000", 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8556000000000002e-05 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496748+0000", 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013118400000000001 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496904+0000", 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015573799999999999 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.498547+0000", 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001643065 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519470+0000", 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020922631000000001 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519497+0000", 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7109000000000001e-05 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.547 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519519+0000", 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2076999999999999e-05 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:114581 5.8 5:135070d4:::benchmark_data_smithi045_43640_object114580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 59.142994567000002, 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020959960999999999, 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.548 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 114581 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343092+0000", 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343091+0000", 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343155+0000", 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3924999999999995e-05 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343164+0000", 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8449999999999992e-06 2024-04-26T12:11:56.550 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.343171+0000", 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9269999999999999e-06 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350524+0000", 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0073536219999999998 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350625+0000", 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000100531 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.350766+0000", 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014109999999999999 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.355024+0000", 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0042578080000000001 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.363951+0000", 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0089271709999999994 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.552 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364008+0000", 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6952e-05 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:57.364052+0000", 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3770000000000003e-05 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:125625 5.0 5:03eb000d:::benchmark_data_smithi045_43640_object125624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:56.553 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 54.191535442000003, 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021434063, 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 125625 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.554 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294551+0000", 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294550+0000", 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294629+0000", 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8850000000000006e-05 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.555 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294643+0000", 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3579e-05 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.294649+0000", 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307771+0000", 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.013122173000000001 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307873+0000", 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102527 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.307978+0000", 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104863 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.314140+0000", 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0061620700000000004 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.557 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315891+0000", 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001751035 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315942+0000", 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0142000000000002e-05 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:02.315985+0000", 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3344999999999999e-05 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.558 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.439811630999998, 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.559 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:56.561 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:56.562 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:56.563 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.439703014000003, 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:56.564 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:56.565 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:56.566 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:56.567 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.568 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.439294470999997, 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.570 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.571 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.572 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:56.573 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:56.574 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.575 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144980 5.4 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.433839311, 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023094001999999999, 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144980 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.576 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052247+0000", 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052246+0000", 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.577 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052303+0000", 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6561999999999998e-05 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052314+0000", 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0969e-05 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052320+0000", 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9200000000000001e-06 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.578 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052349+0000", 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9275e-05 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052469+0000", 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011988400000000001 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.052599+0000", 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000130247 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.579 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.054449+0000", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001850459 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075281+0000", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020831109 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075319+0000", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8279999999999999e-05 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.580 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.075341+0000", 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2098000000000001e-05 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:145239 5.8 5:1d45bdef:::benchmark_data_smithi045_43640_object145238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 45.307119702000001, 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.022028939000000001, 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 145239 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178967+0000", 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.582 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.178966+0000", 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179007+0000", 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0855000000000001e-05 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179012+0000", 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5789999999999997e-06 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.583 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.179016+0000", 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9310000000000001e-06 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.181947+0000", 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0029311279999999999 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182029+0000", 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2196999999999999e-05 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.584 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.182164+0000", 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013485299999999999 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.184437+0000", 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022734090000000001 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200921+0000", 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016483996000000001 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.585 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200961+0000", 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9459999999999998e-05 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.200996+0000", 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4788e-05 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146516 5.f 5:f5e1d3f0:::benchmark_data_smithi045_43640_object146515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:56.586 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.701073973, 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021212505999999999, 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146516 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.587 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785012+0000", 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785116+0000", 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103843 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.588 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785122+0000", 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9030000000000001e-06 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785126+0000", 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3109999999999999e-06 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.789946+0000", 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0048199050000000002 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.589 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.790076+0000", 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000129682 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806098+0000", 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.016022643 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806154+0000", 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5581999999999997e-05 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.590 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806225+0000", 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1000999999999993e-05 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:146520 5.f 5:f2786fd8:::benchmark_data_smithi045_43640_object146519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 44.700914554999997, 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.021177438999999999, 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.591 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 146520 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785172+0000", 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.592 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785171+0000", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785214+0000", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2545e-05 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785219+0000", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7679999999999999e-06 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.593 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.785224+0000", 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6319999999999996e-06 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.791982+0000", 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067578830000000001 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.792120+0000", 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013796300000000001 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.594 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806234+0000", 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.014114234999999999 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806276+0000", 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1916999999999999e-05 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.806349+0000", 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.2916000000000005e-05 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:269468 5.8 5:11204fbf:::benchmark_data_smithi045_43640_object121094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:55.547018+0000", 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.93906834699999997, 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020886097999999999, 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 269468 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.596 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.547018+0000", 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.547018+0000", 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.547018+0000", 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.597 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.547020+0000", 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.897e-06 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.547025+0000", 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0669999999999999e-06 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.547029+0000", 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.598 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.552412+0000", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0053826359999999997 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.552511+0000", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.9720000000000001e-05 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.552579+0000", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7372000000000005e-05 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.556540+0000", 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00396073 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.567854+0000", 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.011314526 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.567883+0000", 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8462999999999998e-05 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:56.600 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:55.567904+0000", 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1477000000000001e-05 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:56.601 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:56.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:11:56.603 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:56.604 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:56.603+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:56.703 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:56.701+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:56.772 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:56.798 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:56.798 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:56.798 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:56.799 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:56.799 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:56.801 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:56.801 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:56.803 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:56.801+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:56.816 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:56.904 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:56.903+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:57.009 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:57.004+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:57.054 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:57.054 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:57.070 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:57.105 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:57.104+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:57.218 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:57.205+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:57.267 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:11:57.307 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:57.307 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:57.307 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:57.306+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:57.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:57.409 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:57.407+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:57.499 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:57.499 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:57.509 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:57.508+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:57.514 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:57.613 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:57.611+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:57.711 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:57.709+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:57.729 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:57.729 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:57.743 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:57.812 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:57.811+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:57.913 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:57.911+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:57.924 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:57.924 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:57.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:58.014 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:58.013+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:58.115 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:58.113+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:58.142 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:58.142 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:58.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:58.216 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:58.215+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:11:58.317 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:58.315+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:58.396 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:58.397 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:58.412 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:11:58.417 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:58.416+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:58.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-26T12:11:58.518 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:58.517+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:58.619 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:58.617+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:58.658 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:58.658 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:58.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:11:58.721 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:58.719+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:58.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:11:58.821 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:58.820+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:58.856 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:11:58.857 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:11:58.872 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:11:58.922 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:58.920+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:58.974 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:11:58.996 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:11:58.996 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:11:58.996 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:11:58.996 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:11:58.999 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:11:58.999 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:11:59.023 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:59.022+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:59.087 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:11:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:11:59.087 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:11:59.088 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:59.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:11:59.183 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:59.144+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:59.225 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:59.224+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:59.316 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:11:59.317 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:11:59.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:11:59.317 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:11:59.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.318 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:59.318 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:59.318 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 73.843818771000002, 2024-04-26T12:11:59.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:11:59.318 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.319 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:59.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:11:59.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:11:59.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:11:59.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:11:59.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 73.842203527999999, 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.329 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:59.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.332 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:11:59.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:11:59.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:11:59.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:11:59.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.925787920000005, 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.83110834, 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.345 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.350 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.825900568999998, 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:11:59.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:11:59.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:11:59.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:11:59.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:11:59.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.358 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:59.359 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:59.359 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.822701610999999, 2024-04-26T12:11:59.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:11:59.359 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.359 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.359 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:11:59.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:11:59.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:11:59.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:11:59.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:11:59.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:11:59.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:11:59.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:11:59.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:11:59.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:11:59.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:11:59.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:11:59.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:11:59.370 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.370 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.370 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.822449802999998, 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.371 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.372 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.372 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:11:59.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.372 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:11:59.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:11:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:11:59.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 69.819793765, 2024-04-26T12:11:59.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:11:59.379 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.379 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.379 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:11:59.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.380 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:59.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:11:59.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:11:59.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:11:59.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:11:59.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:11:59.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.388 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.265890947999999, 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:11:59.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:11:59.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:11:59.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:11:59.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:11:59.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.396 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.265782330999997, 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:11:59.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.401 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:11:59.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:11:59.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:11:59.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:11:59.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:11:59.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:11:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:11:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:11:59.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.405 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.406 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:11:59.406 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:59.406 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 48.265373787999998, 2024-04-26T12:11:59.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:11:59.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.408 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:59.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:11:59.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:11:59.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:11:59.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279494 5.4 5:2a8017ae:::benchmark_data_smithi045_43640_object131120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.18098183500000001, 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051192274000000003, 2024-04-26T12:11:59.413 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279494 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131183+0000", 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131186+0000", 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131191+0000", 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131196+0000", 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132978+0000", 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017828 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133071+0000", 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2901999999999999e-05 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133138+0000", 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6734000000000002e-05 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138348+0000", 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052102620000000002 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182262+0000", 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043913229999999998 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182329+0000", 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7359000000000003e-05 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182376+0000", 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.418 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279498 5.4 5:2608519e:::benchmark_data_smithi045_43640_object131124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.179571973, 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.052255791000000003, 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279498 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.419 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132593+0000", 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132598+0000", 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132608+0000", 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0302999999999999e-05 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132615+0000", 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:11:59.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134454+0000", 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018386889999999999 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134561+0000", 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106913 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134662+0000", 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010153399999999999 2024-04-26T12:11:59.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138369+0000", 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003706539 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184744+0000", 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046375223 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184794+0000", 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:11:59.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184849+0000", 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279503 5.4 5:2991e931:::benchmark_data_smithi045_43640_object131129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17809366700000001, 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050896601999999999, 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.424 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279503 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:11:59.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134071+0000", 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134076+0000", 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134083+0000", 2024-04-26T12:11:59.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3270000000000003e-06 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134088+0000", 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136107+0000", 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020195640000000002 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136204+0000", 2024-04-26T12:11:59.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6837999999999997e-05 2024-04-26T12:11:59.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136272+0000", 2024-04-26T12:11:59.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8064000000000004e-05 2024-04-26T12:11:59.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182395+0000", 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046122877 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184893+0000", 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024983129999999998 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184933+0000", 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9178999999999999e-05 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184969+0000", 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279509 5.4 5:26e9e343:::benchmark_data_smithi045_43640_object131135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.176005209, 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.048926960999999998, 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279509 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136164+0000", 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136171+0000", 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9210000000000003e-06 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136176+0000", 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9660000000000004e-06 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137327+0000", 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011509339999999999 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137395+0000", 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7609999999999998e-05 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137477+0000", 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2826999999999998e-05 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184683+0000", 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047205812 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185010+0000", 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00032656599999999998 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185051+0000", 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0754000000000003e-05 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185087+0000", 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6859000000000001e-05 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279511 5.4 5:22bd527c:::benchmark_data_smithi045_43640_object131137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17530008899999999, 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050522629999999999, 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.436 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279511 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136865+0000", 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136874+0000", 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136882+0000", 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136888+0000", 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182428+0000", 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045540663000000002 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182556+0000", 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127584 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182672+0000", 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116533 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187058+0000", 2024-04-26T12:11:59.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043857310000000004 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187325+0000", 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026685000000000001 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187350+0000", 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5449999999999999e-05 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187388+0000", 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7766999999999999e-05 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279494 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17503522099999999, 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045266883000000001, 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137132+0000", 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3549999999999999e-06 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137135+0000", 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9239999999999999e-06 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137137+0000", 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1969999999999999e-06 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138497+0000", 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013601080000000001 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138504+0000", 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182397+0000", 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043893518999999999 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.446 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:279510 5.a e56/17 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head v 56'17341, mlcod=56'17337)", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17374002999999999, 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051831733999999997, 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:11:59.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138425+0000", 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138430+0000", 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.096e-06 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.448 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138438+0000", 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138444+0000", 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138474+0000", 2024-04-26T12:11:59.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0001e-05 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138498+0000", 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3572999999999999e-05 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190236+0000", 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051737981000000002 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190257+0000", 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1795000000000001e-05 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279498 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17367302400000001, 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046365244999999999, 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138492+0000", 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138496+0000", 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138503+0000", 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138508+0000", 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:11:59.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184722+0000", 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046214098000000002 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184731+0000", 2024-04-26T12:11:59.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184858+0000", 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012661700000000001 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279514 5.0 5:008c068a:::benchmark_data_smithi045_43640_object131140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.17228643299999999, 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047241290999999998, 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279514 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:11:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139878+0000", 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139883+0000", 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3950000000000003e-06 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182261+0000", 2024-04-26T12:11:59.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.042377807000000003 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182281+0000", 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9851e-05 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182332+0000", 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1597000000000001e-05 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:11:59.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182479+0000", 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014700100000000001 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182613+0000", 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013436899999999999 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184655+0000", 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020416449999999999 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187055+0000", 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024002049999999999 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187083+0000", 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7702999999999999e-05 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187120+0000", 2024-04-26T12:11:59.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7449e-05 2024-04-26T12:11:59.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.464 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:11:59.464 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:11:59.464 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:11:59.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:11:59.468 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:59.465+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:59.568 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:59.564+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:59.666 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:59.666 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:11:59.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.666 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:280858 5.e e56/17 5:74784289:::benchmark_data_smithi045_43640_object132484:head v 56'17579, mlcod=56'17576)", 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.656677+0000", 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0075192230000000002, 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0075499130000000001, 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656677+0000", 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656677+0000", 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656676+0000", 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656681+0000", 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2209999999999996e-06 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656689+0000", 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8869999999999992e-06 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656694+0000", 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656719+0000", 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5145999999999999e-05 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.656731+0000", 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.154e-05 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280862 5.6 5:638a94d6:::benchmark_data_smithi045_43640_object132488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.658733+0000", 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0054625660000000003, 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0055711509999999999, 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.670 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280862 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658733+0000", 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658733+0000", 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658733+0000", 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658744+0000", 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1437000000000001e-05 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658751+0000", 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.4470000000000003e-06 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658756+0000", 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1789999999999999e-06 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658795+0000", 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8668999999999999e-05 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658913+0000", 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118108 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.673 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280864 5.6 5:6c39c3a4:::benchmark_data_smithi045_43640_object132490:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.658764+0000", 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0054316729999999997, 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056121690000000002, 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280864 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658764+0000", 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658764+0000", 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658764+0000", 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658766+0000", 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5359999999999999e-06 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658772+0000", 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.852e-06 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658777+0000", 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3430000000000003e-06 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.660755+0000", 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019777699999999998 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.660883+0000", 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000127544 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280865 5.6 5:658d07c6:::benchmark_data_smithi045_43640_object132491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.658794+0000", 2024-04-26T12:11:59.677 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0054019640000000004, 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056512460000000004, 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280865 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658794+0000", 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658794+0000", 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658793+0000", 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658796+0000", 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658803+0000", 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8480000000000003e-06 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658812+0000", 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8089999999999999e-06 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662701+0000", 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0038897239999999998 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662815+0000", 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114057 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280866 5.6 5.746a4d76 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.658820+0000", 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0053756719999999997, 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0056984369999999998, 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:59.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280866 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658820+0000", 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658820+0000", 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658819+0000", 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658822+0000", 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6560000000000001e-06 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658828+0000", 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3550000000000001e-06 2024-04-26T12:11:59.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.658835+0000", 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.939e-06 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280870 5.a 5:54552d32:::benchmark_data_smithi045_43640_object132496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.659602+0000", 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0045939320000000002, 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049834199999999997, 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.684 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280870 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659602+0000", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659602+0000", 2024-04-26T12:11:59.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659601+0000", 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659605+0000", 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3420000000000001e-06 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.686 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659616+0000", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0287e-05 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659623+0000", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659660+0000", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7171e-05 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659751+0000", 2024-04-26T12:11:59.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1636000000000002e-05 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.659819+0000", 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8031e-05 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662374+0000", 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025541510000000002 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280871 5.c 5:3336ec2b:::benchmark_data_smithi045_43640_object132497:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662078+0000", 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00211794, 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026336520000000002, 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280871 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662078+0000", 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662078+0000", 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662077+0000", 2024-04-26T12:11:59.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662087+0000", 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0448000000000001e-05 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662097+0000", 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.6080000000000002e-06 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662104+0000", 2024-04-26T12:11:59.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4710000000000001e-06 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662145+0000", 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0742999999999999e-05 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662267+0000", 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012214499999999999 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280874 5.2 5:4d0f3ffa:::benchmark_data_smithi045_43640_object132500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662117+0000", 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.002078426, 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0026628379999999998, 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280874 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662117+0000", 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662117+0000", 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662117+0000", 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662120+0000", 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.292e-06 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662127+0000", 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.618e-06 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662137+0000", 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.025e-05 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662402+0000", 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00026487499999999997 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662524+0000", 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122423 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:280872 5.8 e56/17 5:1a912190:::benchmark_data_smithi045_43640_object132498:head v 56'17152, mlcod=56'17150)", 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662350+0000", 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0018459189999999999, 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024798929999999999, 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662350+0000", 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.697 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662350+0000", 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662349+0000", 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662354+0000", 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7140000000000001e-06 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662361+0000", 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662366+0000", 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662536+0000", 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00016947800000000001 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662554+0000", 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8181000000000001e-05 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:280873 5.0 e56/17 5:02de4380:::benchmark_data_smithi045_43640_object132499:head v 56'17639, mlcod=56'17637)", 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662376+0000", 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0018198310000000001, 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025024349999999999, 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662376+0000", 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662376+0000", 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662376+0000", 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662379+0000", 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6200000000000001e-06 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662385+0000", 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.524e-06 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662390+0000", 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662772+0000", 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00038236900000000002 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662799+0000", 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6228e-05 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280875 5.2 5:4868e500:::benchmark_data_smithi045_43640_object132501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.703 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662425+0000", 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0017709290000000001, 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0024902610000000001, 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280875 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662425+0000", 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662425+0000", 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662424+0000", 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662428+0000", 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6710000000000001e-06 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662435+0000", 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662442+0000", 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3329999999999999e-06 2024-04-26T12:11:59.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664500+0000", 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0020577859999999998 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664622+0000", 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012214699999999999 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280876 5.a 5:55d8715f:::benchmark_data_smithi045_43640_object132502:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662448+0000", 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001747766, 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025052659999999999, 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280876 2024-04-26T12:11:59.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662448+0000", 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662448+0000", 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662448+0000", 2024-04-26T12:11:59.709 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662450+0000", 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2110000000000001e-06 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662458+0000", 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7060000000000004e-06 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662462+0000", 2024-04-26T12:11:59.710 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9450000000000001e-06 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664283+0000", 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001820959 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664410+0000", 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012621 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664539+0000", 2024-04-26T12:11:59.711 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012899499999999999 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:280877 5.6 5.66a897f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.662472+0000", 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.001723301, 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025220500000000001, 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:11:59.712 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 280877 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662472+0000", 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662472+0000", 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662472+0000", 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662475+0000", 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.6199999999999999e-06 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662481+0000", 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3999999999999997e-06 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.662486+0000", 2024-04-26T12:11:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4099999999999999e-06 2024-04-26T12:11:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:280879 5.b e56/17 5:d16ca5d7:::benchmark_data_smithi045_43640_object132505:head v 56'17392, mlcod=56'17390)", 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.663090+0000", 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0011054700000000001, 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0019504360000000001, 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663090+0000", 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663090+0000", 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663090+0000", 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663096+0000", 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2099999999999998e-06 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.720 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663108+0000", 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.199e-05 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663115+0000", 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.165e-06 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663170+0000", 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5288999999999999e-05 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.721 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.663193+0000", 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2340999999999998e-05 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:280878 5.0 e56/17)", 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.664005+0000", 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00019105000000000001, 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00107464, 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:11:59.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664005+0000", 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664005+0000", 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664004+0000", 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:11:59.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664010+0000", 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0839999999999997e-06 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664022+0000", 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2238e-05 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.664029+0000", 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5470000000000002e-06 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.724 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:11:59.725 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.725 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:11:59.725 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:11:59.725 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 15 2024-04-26T12:11:59.725 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:59.726 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:59.668+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:59.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:11:59.768 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:11:59.766+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:11:59.868 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:59.867+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:59.962 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:11:59.962 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:11:59.962 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:11:59.962 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:11:59.962 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:11:59.969 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:11:59.968+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:11:59.979 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:00.070 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:00.068+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:00.171 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:00.169+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:00.176 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.196612548000004, 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.177 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:12:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:12:00.180 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.181 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.182 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 74.705423517, 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.183 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.184 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.185 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.186 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.187 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 74.703072141000007, 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:12:00.188 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.189 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:12:00.190 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.191 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.192 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.689973858000002, 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:00.193 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.194 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:12:00.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.686718881000004, 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.197 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.198 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.200 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.200 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:12:00.200 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.201 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.202 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.684221206000004, 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.203 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:12:00.204 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.205 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:12:00.206 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:12:00.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.206 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.206 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.206 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.207 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:00.208 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.683537904999994, 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:12:00.210 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:12:00.211 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 70.681417389000003, 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.213 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.214 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.215 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:12:00.216 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 49.120753972000003, 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:00.217 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.218 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.219 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.220 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 40.140485495, 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.221 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.222 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.223 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.224 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.225 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.285987630000001, 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.226 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:00.227 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:12:00.228 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.229 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.230 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 22.898858668999999, 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.231 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:00.232 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.233 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.236 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279510 5.a 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.0372661080000001, 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.054251191999999997, 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279510 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136124+0000", 2024-04-26T12:12:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136127+0000", 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.616e-06 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136133+0000", 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136138+0000", 2024-04-26T12:12:00.239 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1719999999999998e-06 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138045+0000", 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001906951 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138189+0000", 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014377899999999999 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138303+0000", 2024-04-26T12:12:00.240 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113818 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140841+0000", 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025384349999999999 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190315+0000", 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049474016000000003 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.241 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190343+0000", 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7670000000000001e-05 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190376+0000", 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2861999999999998e-05 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279512 5.a 5:506620c5:::benchmark_data_smithi045_43640_object131138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.242 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.036117717, 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053205386, 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279512 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137272+0000", 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137277+0000", 2024-04-26T12:12:00.244 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137285+0000", 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137291+0000", 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.84e-06 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139486+0000", 2024-04-26T12:12:00.245 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021944460000000001 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139576+0000", 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0016e-05 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139661+0000", 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4876999999999994e-05 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140848+0000", 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011877789999999999 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.249 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190405+0000", 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049556986999999997 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190444+0000", 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8711999999999998e-05 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190478+0000", 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4437999999999998e-05 2024-04-26T12:12:00.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279513 5.a 5:56a75d68:::benchmark_data_smithi045_43640_object131139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.034621322, 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051809704999999998, 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.251 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279513 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.252 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138773+0000", 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1150000000000004e-06 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138782+0000", 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8659999999999995e-06 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.253 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138788+0000", 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6710000000000004e-06 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140872+0000", 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002084757 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141001+0000", 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012882900000000001 2024-04-26T12:12:00.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141128+0000", 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012668799999999999 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145398+0000", 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042697710000000003 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.255 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190512+0000", 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.045114639999999998 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190550+0000", 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7351999999999997e-05 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190579+0000", 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9611000000000002e-05 2024-04-26T12:12:00.256 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279516 5.a 5:56b1c475:::benchmark_data_smithi045_43640_object131142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.0323974570000001, 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.052473375000000003, 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279516 2024-04-26T12:12:00.257 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.258 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140997+0000", 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141009+0000", 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1697e-05 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.259 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141015+0000", 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3339999999999998e-06 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142442+0000", 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001426166 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142531+0000", 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9800000000000001e-05 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142609+0000", 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7585999999999999e-05 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146926+0000", 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043168249999999998 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193382+0000", 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046456467000000001 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.261 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193430+0000", 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7508e-05 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193467+0000", 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7015999999999999e-05 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279518 5.a 5:57f8d5df:::benchmark_data_smithi045_43640_object131144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.0310395290000001, 2024-04-26T12:12:00.262 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051251170999999998, 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279518 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142353+0000", 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2709999999999999e-06 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142362+0000", 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1200000000000008e-06 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142366+0000", 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8130000000000002e-06 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143469+0000", 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001103 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143546+0000", 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6816000000000005e-05 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143611+0000", 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5492000000000002e-05 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146930+0000", 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033186999999999999 2024-04-26T12:12:00.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193518+0000", 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046587564999999997 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193564+0000", 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6090000000000001e-05 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193602+0000", 2024-04-26T12:12:00.267 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8800000000000001e-05 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279519 5.a 5:55c308c1:::benchmark_data_smithi045_43640_object131145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.0307883819999999, 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051119220999999999, 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.268 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279519 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142606+0000", 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2769999999999999e-06 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142616+0000", 2024-04-26T12:12:00.270 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7259999999999997e-06 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142623+0000", 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144446+0000", 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001823627 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144542+0000", 2024-04-26T12:12:00.271 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.556e-05 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144607+0000", 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5412000000000003e-05 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146934+0000", 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023270040000000001 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193638+0000", 2024-04-26T12:12:00.272 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046703421000000002 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193681+0000", 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3409999999999999e-05 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193722+0000", 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0466999999999997e-05 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279521 5.a 5:5bb84d9c:::benchmark_data_smithi045_43640_object131147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 1.030710799, 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053246825999999997, 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279521 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142679+0000", 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142683+0000", 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6229999999999999e-06 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142691+0000", 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1270000000000003e-06 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142697+0000", 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3389999999999998e-06 2024-04-26T12:12:00.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145438+0000", 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027404679999999998 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145515+0000", 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6913e-05 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145587+0000", 2024-04-26T12:12:00.277 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2484000000000006e-05 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146938+0000", 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013503390000000001 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195863+0000", 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.048925457999999998 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195890+0000", 2024-04-26T12:12:00.278 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7158999999999999e-05 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195927+0000", 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6569000000000002e-05 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:281444 5.6 5:6edbfc9d:::benchmark_data_smithi045_43640_object133070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.31102772499999998, 2024-04-26T12:12:00.279 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022540986999999998, 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 281444 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.280 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862366+0000", 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.281 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862374+0000", 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2430000000000005e-06 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862380+0000", 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.173e-06 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.867290+0000", 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049099920000000002 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.282 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.871681+0000", 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004390489 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884771+0000", 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013090421 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884824+0000", 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2766000000000003e-05 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:00.283 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884904+0000", 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9946999999999999e-05 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:00.284 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:00.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:12:00.286 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:00.284+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:00.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:00.386 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:00.384+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:00.463 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:283057 5.e 5:7fcb5be8:::benchmark_data_smithi045_43640_object134683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:00.456548+0000", 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.006716222, 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0067344880000000003, 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.464 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 283057 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.456548+0000", 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.456548+0000", 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.456547+0000", 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.456551+0000", 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2370000000000003e-06 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.456560+0000", 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3470000000000005e-06 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.456568+0000", 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5009999999999998e-06 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.457306+0000", 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00073842199999999997 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.457457+0000", 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015078499999999999 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.457580+0000", 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000122707 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.459918+0000", 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023384410000000001 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:283070 5.a e56/17 5:5dd5d371:::benchmark_data_smithi045_43640_object134696:head v 56'17577, mlcod=56'17574)", 2024-04-26T12:12:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:00.462483+0000", 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.00078130799999999998, 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00085146400000000002, 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462483+0000", 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462483+0000", 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462482+0000", 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462486+0000", 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9600000000000002e-06 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462494+0000", 2024-04-26T12:12:00.470 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.8660000000000006e-06 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462499+0000", 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462527+0000", 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8483000000000002e-05 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:00.462538+0000", 2024-04-26T12:12:00.471 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.1245e-05 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 2 2024-04-26T12:12:00.472 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:00.480 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:00.489 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:00.487+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:00.588 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:00.587+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:00.653 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:00.653 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:00.653 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:12:00.653 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:12:00.653 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:00.667 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:00.689 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:00.687+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:00.790 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:00.788+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.417036275000001, 2024-04-26T12:12:00.889 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:12:00.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.415421031999998, 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.896 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:00.901 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.499005424000003, 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:12:00.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:12:00.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.404325843999999, 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.907 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:12:00.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:12:00.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:12:00.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.399118072999997, 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:12:00.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:12:00.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.395919114999998, 2024-04-26T12:12:00.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.919 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:12:00.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.923 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.395667306999997, 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.924 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:12:00.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:12:00.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:12:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:00.929 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 71.393011268999999, 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:12:00.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:12:00.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:12:00.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.839108451999998, 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.935 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.939 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:00.940 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.838999835000003, 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:00.941 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:12:00.942 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:12:00.943 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.944 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.945 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 49.838591291999997, 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.946 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:12:00.948 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.949 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.950 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.951 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279494 5.4 5:2a8017ae:::benchmark_data_smithi045_43640_object131120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.7541993389999999, 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051192274000000003, 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279494 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.952 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131183+0000", 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.953 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131186+0000", 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131191+0000", 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131196+0000", 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:12:00.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132978+0000", 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017828 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133071+0000", 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2901999999999999e-05 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133138+0000", 2024-04-26T12:12:00.955 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6734000000000002e-05 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138348+0000", 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052102620000000002 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182262+0000", 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043913229999999998 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.956 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182329+0000", 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7359000000000003e-05 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182376+0000", 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279498 5.4 5:2608519e:::benchmark_data_smithi045_43640_object131124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.7527894769999999, 2024-04-26T12:12:00.957 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.052255791000000003, 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279498 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.958 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132593+0000", 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132598+0000", 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:12:00.959 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132608+0000", 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0302999999999999e-05 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132615+0000", 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134454+0000", 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018386889999999999 2024-04-26T12:12:00.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134561+0000", 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106913 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134662+0000", 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010153399999999999 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138369+0000", 2024-04-26T12:12:00.961 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003706539 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184744+0000", 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046375223 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184794+0000", 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:12:00.962 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184849+0000", 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279503 5.4 5:2991e931:::benchmark_data_smithi045_43640_object131129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.751311171, 2024-04-26T12:12:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050896601999999999, 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279503 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.964 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134071+0000", 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134076+0000", 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.965 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134083+0000", 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3270000000000003e-06 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134088+0000", 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136107+0000", 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020195640000000002 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.966 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136204+0000", 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6837999999999997e-05 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136272+0000", 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8064000000000004e-05 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182395+0000", 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046122877 2024-04-26T12:12:00.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184893+0000", 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024983129999999998 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184933+0000", 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9178999999999999e-05 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184969+0000", 2024-04-26T12:12:00.968 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279509 5.4 5:26e9e343:::benchmark_data_smithi045_43640_object131135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.749222713, 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.048926960999999998, 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279509 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.970 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136164+0000", 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136171+0000", 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9210000000000003e-06 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.971 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136176+0000", 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9660000000000004e-06 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137327+0000", 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011509339999999999 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137395+0000", 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7609999999999998e-05 2024-04-26T12:12:00.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137477+0000", 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2826999999999998e-05 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184683+0000", 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047205812 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185010+0000", 2024-04-26T12:12:00.973 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00032656599999999998 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185051+0000", 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0754000000000003e-05 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185087+0000", 2024-04-26T12:12:00.974 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6859000000000001e-05 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279511 5.4 5:22bd527c:::benchmark_data_smithi045_43640_object131137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.7485175929999999, 2024-04-26T12:12:00.975 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050522629999999999, 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279511 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.976 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136865+0000", 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136874+0000", 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.977 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136882+0000", 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136888+0000", 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182428+0000", 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045540663000000002 2024-04-26T12:12:00.978 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182556+0000", 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127584 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182672+0000", 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116533 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187058+0000", 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043857310000000004 2024-04-26T12:12:00.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187325+0000", 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026685000000000001 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187350+0000", 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5449999999999999e-05 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187388+0000", 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7766999999999999e-05 2024-04-26T12:12:00.980 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279494 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.748252725, 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045266883000000001, 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:00.981 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.982 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137132+0000", 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3549999999999999e-06 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137135+0000", 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9239999999999999e-06 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137137+0000", 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1969999999999999e-06 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138497+0000", 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013601080000000001 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138504+0000", 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182397+0000", 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043893518999999999 2024-04-26T12:12:00.984 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:279510 5.a e56/17 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head v 56'17341, mlcod=56'17337)", 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.7469575339999999, 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051831733999999997, 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:00.985 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138425+0000", 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.986 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138430+0000", 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.096e-06 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138438+0000", 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138444+0000", 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.987 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138474+0000", 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0001e-05 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138498+0000", 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3572999999999999e-05 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190236+0000", 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051737981000000002 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.988 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190257+0000", 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1795000000000001e-05 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279498 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.746890528, 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046365244999999999, 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.989 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138492+0000", 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:00.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138496+0000", 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138503+0000", 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138508+0000", 2024-04-26T12:12:00.991 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184722+0000", 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046214098000000002 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184731+0000", 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184858+0000", 2024-04-26T12:12:00.992 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012661700000000001 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279514 5.0 5:008c068a:::benchmark_data_smithi045_43640_object131140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 1.7455039370000001, 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047241290999999998, 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:00.993 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279514 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139878+0000", 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139883+0000", 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3950000000000003e-06 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182261+0000", 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.042377807000000003 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.995 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182281+0000", 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9851e-05 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182332+0000", 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1597000000000001e-05 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182479+0000", 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014700100000000001 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.996 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182613+0000", 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013436899999999999 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184655+0000", 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020416449999999999 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187055+0000", 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024002049999999999 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.997 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187083+0000", 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7702999999999999e-05 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187120+0000", 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7449e-05 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:01.000 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:01.000 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:00.998+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:01.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:12:01.101 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:01.098+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:01.171 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:12:01.196 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:12:01.196 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:12:01.196 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:12:01.196 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:12:01.198 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:01.198 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:01.199 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:12:01.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:12:01.201 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:01.200+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:01.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:01.274 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is set 2024-04-26T12:12:01.302 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:01.300+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:01.404 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:01.402+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:01.458 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:01.459 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:01.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:01.521 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:01.517+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:01.605 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:01.603+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:01.705 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:01.704+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:01.715 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:01.715 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:01.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:01.807 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:01.806+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:01.908 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:01.907+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:01.919 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:01.920 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:01.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:02.020 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:02.019+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:02.113 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:02.111+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:02.154 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:02.154 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:02.167 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:02.252 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:02.250+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:02.313 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:02.311+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:02.363 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:02.363 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:02.373 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:02.417 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:02.415+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:02.515 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:02.513+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:02.566 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:02.566 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:02.584 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:02.627 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:02.624+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:02.717 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:02.715+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:02.817 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:02.816+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:02.824 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:02.824 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:02.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:02.926 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:02.924+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.019 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:03.016+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.075 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:03.075 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:03.091 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:03.132 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:03.130+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:12:03.220 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:03.218+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.270 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:03.271 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:03.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:03.290 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:12:03.322 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:03.320+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.422 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:12:03.423 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:03.421+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:03.441 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:03.441 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:03.441 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:12:03.441 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:12:03.441 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:03.447 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:12:03.447 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:12:03.447 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:12:03.447 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:12:03.450 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:12:03.450 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:12:03.455 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:03.523 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:03.521+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.623 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:03.622+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:03.676 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:03.676 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:12:03.676 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:12:03.676 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.204438705000001, 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.677 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.678 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.679 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:12:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:12:03.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:12:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.202823461999998, 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.683 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.684 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.685 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:12:03.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:12:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:12:03.688 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 74.286407854000004, 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.689 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.690 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:12:03.691 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.692 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:12:03.693 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:12:03.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.694 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.694 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.694 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:12:03.694 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:12:03.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.695 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.695 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.695 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:12:03.695 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:12:03.695 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.696 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:12:03.697 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:12:03.697 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.697 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.697 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.697 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:12:03.698 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:12:03.698 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.698 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.698 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.698 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.698 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.699 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:03.699 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:03.699 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 74.191728273999999, 2024-04-26T12:12:03.699 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:12:03.699 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.699 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.700 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.700 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.700 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.700 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:12:03.700 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.700 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.701 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.702 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.703 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:12:03.704 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.705 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.705 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.705 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:12:03.705 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:12:03.706 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.706 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.706 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.706 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:12:03.707 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:12:03.707 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.707 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.708 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.708 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:12:03.708 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:12:03.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.708 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.709 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:12:03.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:12:03.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.710 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.710 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.710 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:12:03.710 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:12:03.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.711 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.711 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.711 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:12:03.711 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:12:03.711 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.712 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.712 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.712 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:12:03.712 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:12:03.712 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.713 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.713 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.713 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.713 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:03.713 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 74.186520502999997, 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.714 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:12:03.716 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.717 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.718 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:12:03.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.720 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 74.183321544999998, 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.721 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.722 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:12:03.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:12:03.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.725 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:12:03.726 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 74.183069736999997, 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.727 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.728 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:12:03.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:12:03.731 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.732 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:03.733 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 74.180413698999999, 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.734 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.735 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:12:03.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:12:03.737 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.738 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.739 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 52.626510881999998, 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.740 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.741 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.742 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.743 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.744 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.745 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 52.626402265000003, 2024-04-26T12:12:03.746 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.747 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.748 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:12:03.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:12:03.751 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:12:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 52.625993721999997, 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.754 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.755 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.756 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:12:03.757 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:12:03.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.757 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.757 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.757 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:12:03.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:12:03.758 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.758 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.758 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.758 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:12:03.758 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.759 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:12:03.761 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:12:03.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.761 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.761 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.761 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:12:03.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:12:03.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.762 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.762 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.762 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:12:03.762 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:12:03.763 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.763 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.763 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.763 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:12:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:12:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:12:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:12:03.765 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.765 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.765 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.765 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.766 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279494 5.4 5:2a8017ae:::benchmark_data_smithi045_43640_object131120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:03.766 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:03.766 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5416017689999997, 2024-04-26T12:12:03.766 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051192274000000003, 2024-04-26T12:12:03.766 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.766 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.767 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.767 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.767 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.767 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279494 2024-04-26T12:12:03.767 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.767 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.768 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.768 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:03.768 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.768 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.768 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.769 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:03.769 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.769 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.769 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.770 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131183+0000", 2024-04-26T12:12:03.770 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.770 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.770 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.770 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.771 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131186+0000", 2024-04-26T12:12:03.771 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:12:03.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.771 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.772 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131191+0000", 2024-04-26T12:12:03.772 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:12:03.772 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.772 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.772 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.773 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131196+0000", 2024-04-26T12:12:03.773 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:12:03.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.773 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.773 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.774 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132978+0000", 2024-04-26T12:12:03.774 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017828 2024-04-26T12:12:03.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.774 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.775 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133071+0000", 2024-04-26T12:12:03.775 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2901999999999999e-05 2024-04-26T12:12:03.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.775 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.776 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133138+0000", 2024-04-26T12:12:03.776 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6734000000000002e-05 2024-04-26T12:12:03.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.776 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.776 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138348+0000", 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052102620000000002 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182262+0000", 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043913229999999998 2024-04-26T12:12:03.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182329+0000", 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7359000000000003e-05 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182376+0000", 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.778 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279498 5.4 5:2608519e:::benchmark_data_smithi045_43640_object131124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5401919069999996, 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.052255791000000003, 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279498 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.779 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132593+0000", 2024-04-26T12:12:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132598+0000", 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132608+0000", 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0302999999999999e-05 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.781 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132615+0000", 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134454+0000", 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018386889999999999 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134561+0000", 2024-04-26T12:12:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106913 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134662+0000", 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010153399999999999 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138369+0000", 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003706539 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.783 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184744+0000", 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046375223 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184794+0000", 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184849+0000", 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.784 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279503 5.4 5:2991e931:::benchmark_data_smithi045_43640_object131129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5387136009999995, 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050896601999999999, 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279503 2024-04-26T12:12:03.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.786 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134071+0000", 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134076+0000", 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134083+0000", 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3270000000000003e-06 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.787 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134088+0000", 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136107+0000", 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020195640000000002 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136204+0000", 2024-04-26T12:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6837999999999997e-05 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136272+0000", 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8064000000000004e-05 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182395+0000", 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046122877 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.789 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184893+0000", 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024983129999999998 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184933+0000", 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9178999999999999e-05 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.790 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184969+0000", 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279509 5.4 5:26e9e343:::benchmark_data_smithi045_43640_object131135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:03.791 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5366251430000002, 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.048926960999999998, 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279509 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.793 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136164+0000", 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136171+0000", 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9210000000000003e-06 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136176+0000", 2024-04-26T12:12:03.794 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9660000000000004e-06 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137327+0000", 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011509339999999999 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137395+0000", 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7609999999999998e-05 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137477+0000", 2024-04-26T12:12:03.795 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2826999999999998e-05 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184683+0000", 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047205812 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185010+0000", 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00032656599999999998 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185051+0000", 2024-04-26T12:12:03.796 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0754000000000003e-05 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185087+0000", 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6859000000000001e-05 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279511 5.4 5:22bd527c:::benchmark_data_smithi045_43640_object131137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5359200230000001, 2024-04-26T12:12:03.797 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050522629999999999, 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279511 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.798 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136865+0000", 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136874+0000", 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:12:03.799 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136882+0000", 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136888+0000", 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182428+0000", 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045540663000000002 2024-04-26T12:12:03.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182556+0000", 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127584 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182672+0000", 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116533 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187058+0000", 2024-04-26T12:12:03.801 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043857310000000004 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187325+0000", 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026685000000000001 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187350+0000", 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5449999999999999e-05 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.802 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187388+0000", 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7766999999999999e-05 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279494 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5356551549999997, 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045266883000000001, 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.803 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:03.804 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137132+0000", 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3549999999999999e-06 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137135+0000", 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9239999999999999e-06 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137137+0000", 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1969999999999999e-06 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138497+0000", 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013601080000000001 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138504+0000", 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.806 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182397+0000", 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043893518999999999 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:279510 5.a e56/17 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head v 56'17341, mlcod=56'17337)", 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:03.807 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5343599640000001, 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051831733999999997, 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.809 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138425+0000", 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.810 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.811 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138430+0000", 2024-04-26T12:12:03.811 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.096e-06 2024-04-26T12:12:03.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.811 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.811 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138438+0000", 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138444+0000", 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:12:03.812 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138474+0000", 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0001e-05 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138498+0000", 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3572999999999999e-05 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.813 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190236+0000", 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051737981000000002 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190257+0000", 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1795000000000001e-05 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.814 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279498 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.534292958, 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046365244999999999, 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.815 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.816 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:03.817 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.817 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.817 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.817 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138492+0000", 2024-04-26T12:12:03.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:03.818 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.818 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.818 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.818 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138496+0000", 2024-04-26T12:12:03.818 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:12:03.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.819 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.819 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.819 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138503+0000", 2024-04-26T12:12:03.819 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:12:03.819 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.820 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.820 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138508+0000", 2024-04-26T12:12:03.820 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:12:03.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.820 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.821 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184722+0000", 2024-04-26T12:12:03.821 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046214098000000002 2024-04-26T12:12:03.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.821 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.821 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184731+0000", 2024-04-26T12:12:03.822 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:12:03.822 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.822 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.822 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.822 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184858+0000", 2024-04-26T12:12:03.823 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012661700000000001 2024-04-26T12:12:03.823 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.823 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.823 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.824 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.824 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279514 5.0 5:008c068a:::benchmark_data_smithi045_43640_object131140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:03.824 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:03.824 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4.5329063669999998, 2024-04-26T12:12:03.824 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047241290999999998, 2024-04-26T12:12:03.825 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:03.825 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:03.825 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:03.825 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:03.825 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:03.825 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279514 2024-04-26T12:12:03.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.826 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:03.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.826 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:03.826 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:03.827 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.827 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.827 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.827 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:03.827 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:03.828 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:03.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.828 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.828 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:03.828 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139878+0000", 2024-04-26T12:12:03.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:03.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.829 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.829 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:03.829 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139883+0000", 2024-04-26T12:12:03.829 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3950000000000003e-06 2024-04-26T12:12:03.830 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.830 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.830 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:03.830 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182261+0000", 2024-04-26T12:12:03.830 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.042377807000000003 2024-04-26T12:12:03.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.831 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.831 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:03.831 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182281+0000", 2024-04-26T12:12:03.831 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9851e-05 2024-04-26T12:12:03.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.832 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.832 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:03.832 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182332+0000", 2024-04-26T12:12:03.832 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1597000000000001e-05 2024-04-26T12:12:03.832 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182479+0000", 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014700100000000001 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182613+0000", 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013436899999999999 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:03.833 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184655+0000", 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020416449999999999 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187055+0000", 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024002049999999999 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187083+0000", 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7702999999999999e-05 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:03.834 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187120+0000", 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7449e-05 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:03.835 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:03.837 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:03.834+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:03.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:03.938 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:03.937+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:04.039 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:04.038+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:04.044 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:04.045 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:12:04.045 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.045 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:292681 5.b e57/17 5:d2ac70d4:::benchmark_data_smithi045_43640_object144307:head v 57'18111, mlcod=57'18107)", 2024-04-26T12:12:04.045 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.034766+0000", 2024-04-26T12:12:04.045 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0053900570000000002, 2024-04-26T12:12:04.045 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0054205169999999997, 2024-04-26T12:12:04.046 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.046 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.046 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.046 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.046 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034766+0000", 2024-04-26T12:12:04.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.047 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.047 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.047 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034766+0000", 2024-04-26T12:12:04.047 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.048 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.048 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.048 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.048 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034766+0000", 2024-04-26T12:12:04.048 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.048 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034772+0000", 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.9880000000000001e-06 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.049 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034779+0000", 2024-04-26T12:12:04.050 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9399999999999996e-06 2024-04-26T12:12:04.050 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.050 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.050 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034784+0000", 2024-04-26T12:12:04.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3499999999999996e-06 2024-04-26T12:12:04.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.051 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.051 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034827+0000", 2024-04-26T12:12:04.051 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.32e-05 2024-04-26T12:12:04.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.052 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.052 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034846+0000", 2024-04-26T12:12:04.052 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8647999999999998e-05 2024-04-26T12:12:04.052 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.053 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.053 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.053 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.053 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.053 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292688 5.7 5:e418802c:::benchmark_data_smithi045_43640_object144314:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.053 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.035815+0000", 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0043413380000000001, 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0044575719999999999, 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.054 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292688 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035815+0000", 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035815+0000", 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035815+0000", 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035817+0000", 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.4700000000000001e-06 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035822+0000", 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0010000000000001e-06 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035826+0000", 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2780000000000004e-06 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.036425+0000", 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00059895599999999999 2024-04-26T12:12:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.036539+0000", 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00011383999999999999 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292689 5.3 5.1b5141a3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.035835+0000", 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0043213959999999999, 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004511414, 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292689 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035835+0000", 2024-04-26T12:12:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035835+0000", 2024-04-26T12:12:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035835+0000", 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035837+0000", 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0619999999999999e-06 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035842+0000", 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.5339999999999999e-06 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.035847+0000", 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.498e-06 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:292692 5.b e57/17)", 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.039158+0000", 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00099846200000000009, 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001244677, 2024-04-26T12:12:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:12:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039158+0000", 2024-04-26T12:12:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039158+0000", 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039157+0000", 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039164+0000", 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039175+0000", 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0818999999999999e-05 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039182+0000", 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4209999999999998e-06 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292693 5.7 5:e175880a:::benchmark_data_smithi045_43640_object144319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.039178+0000", 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0009781150000000001, 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001282226, 2024-04-26T12:12:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292693 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039178+0000", 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039178+0000", 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039177+0000", 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039182+0000", 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0760000000000002e-06 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039190+0000", 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3579999999999997e-06 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039195+0000", 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039225+0000", 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9859999999999999e-05 2024-04-26T12:12:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039299+0000", 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3804e-05 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292697 5.6 5:62c4515a:::benchmark_data_smithi045_43640_object144323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.039882+0000", 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00027405799999999998, 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00064475000000000003, 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292697 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039882+0000", 2024-04-26T12:12:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039882+0000", 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039882+0000", 2024-04-26T12:12:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039886+0000", 2024-04-26T12:12:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.4630000000000003e-06 2024-04-26T12:12:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039894+0000", 2024-04-26T12:12:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7670000000000003e-06 2024-04-26T12:12:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039902+0000", 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1370000000000002e-06 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039941+0000", 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8594999999999999e-05 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040070+0000", 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000129589 2024-04-26T12:12:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292698 5.7 5.c9d93f37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.039917+0000", 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.00023914699999999999, 2024-04-26T12:12:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00067333200000000001, 2024-04-26T12:12:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "queued for pg", 2024-04-26T12:12:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292698 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039917+0000", 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039917+0000", 2024-04-26T12:12:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039917+0000", 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039920+0000", 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:12:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039927+0000", 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039934+0000", 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2389999999999999e-06 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292700 5.2 5:43de1c2c:::benchmark_data_smithi045_43640_object144326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.040056+0000", 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.000100844, 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00059075600000000001, 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292700 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040056+0000", 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040056+0000", 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040055+0000", 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040058+0000", 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.509e-06 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040065+0000", 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5839999999999997e-06 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040072+0000", 2024-04-26T12:12:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1920000000000002e-06 2024-04-26T12:12:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040118+0000", 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6322000000000001e-05 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040222+0000", 2024-04-26T12:12:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000104447 2024-04-26T12:12:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:292695 5.e e57/17 5:701b52ee:::benchmark_data_smithi045_43640_object144321:head v 57'18340, mlcod=57'18338)", 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.040174+0000", 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999824, 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00054138400000000001, 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040174+0000", 2024-04-26T12:12:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040174+0000", 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040173+0000", 2024-04-26T12:12:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040180+0000", 2024-04-26T12:12:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.2689999999999996e-06 2024-04-26T12:12:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040189+0000", 2024-04-26T12:12:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9099999999999994e-06 2024-04-26T12:12:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040195+0000", 2024-04-26T12:12:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8029999999999999e-06 2024-04-26T12:12:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040229+0000", 2024-04-26T12:12:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3614e-05 2024-04-26T12:12:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040250+0000", 2024-04-26T12:12:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0931999999999999e-05 2024-04-26T12:12:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:292696 5.8 e57/17 5:1d9b5d4e:::benchmark_data_smithi045_43640_object144322:head v 57'17874, mlcod=57'17872)", 2024-04-26T12:12:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.040210+0000", 2024-04-26T12:12:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4294967295.9999466, 2024-04-26T12:12:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00057562599999999998, 2024-04-26T12:12:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040210+0000", 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040210+0000", 2024-04-26T12:12:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040209+0000", 2024-04-26T12:12:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040214+0000", 2024-04-26T12:12:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5170000000000001e-06 2024-04-26T12:12:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040220+0000", 2024-04-26T12:12:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.0310000000000004e-06 2024-04-26T12:12:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040225+0000", 2024-04-26T12:12:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9819999999999999e-06 2024-04-26T12:12:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040275+0000", 2024-04-26T12:12:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.9920000000000003e-05 2024-04-26T12:12:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.040293+0000", 2024-04-26T12:12:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8391000000000001e-05 2024-04-26T12:12:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292672 5.3 5:c9afdc37:::benchmark_data_smithi045_43640_object144298:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.030953+0000", 2024-04-26T12:12:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0092037860000000003, 2024-04-26T12:12:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0099046550000000001, 2024-04-26T12:12:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292672 2024-04-26T12:12:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.030953+0000", 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.030953+0000", 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.030952+0000", 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.030956+0000", 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3640000000000001e-06 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.030964+0000", 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3479999999999998e-06 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.030969+0000", 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.541e-06 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034444+0000", 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00347475 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.034593+0000", 2024-04-26T12:12:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014867 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292679 5.3 5:cfa0e690:::benchmark_data_smithi045_43640_object144305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.033651+0000", 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0065056269999999999, 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0072857460000000001, 2024-04-26T12:12:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292679 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033651+0000", 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033651+0000", 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033650+0000", 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033656+0000", 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8719999999999999e-06 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033666+0000", 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0732e-05 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033674+0000", 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6550000000000004e-06 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.036878+0000", 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.003204232 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.037015+0000", 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000136799 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:292680 5.3 5:c32a9818:::benchmark_data_smithi045_43640_object144306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:12:04.033682+0000", 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 0.0064746279999999996, 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.007321742, 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "started", 2024-04-26T12:12:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 292680 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033682+0000", 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033682+0000", 2024-04-26T12:12:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033681+0000", 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033684+0000", 2024-04-26T12:12:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.5220000000000002e-06 2024-04-26T12:12:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033690+0000", 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1600000000000003e-06 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.033694+0000", 2024-04-26T12:12:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.9790000000000004e-06 2024-04-26T12:12:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.038990+0000", 2024-04-26T12:12:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.005295615 2024-04-26T12:12:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:12:04.039114+0000", 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012404000000000001 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-26T12:12:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 13 2024-04-26T12:12:04.129 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:04.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:04.142 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:04.139+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:04.241 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:04.239+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:04.280 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:12:04.328 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:04.328 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:12:04.329 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:12:04.329 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:12:04.329 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:04.342 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:04.340+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:04.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:04.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-04-26T12:12:04.443 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:04.442+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:04.544 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:04.542+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 84.611551258000006, 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.601 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.602 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.603 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.604 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.605 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.606 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.120362227000001, 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:12:04.609 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:04.612 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.118010850999994, 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:12:04.615 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.104912568000003, 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.617 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:04.618 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.618 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:12:04.619 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.620 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.101657591000006, 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.622 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:04.623 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:12:04.624 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:12:04.625 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.099159916000005, 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:12:04.626 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.627 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.628 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.629 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.098476614999996, 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.631 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:12:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:12:04.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:12:04.635 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 75.096356099000005, 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:12:04.637 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:12:04.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.639 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 53.535692681999997, 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:04.640 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:12:04.641 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.642 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 44.555424205000001, 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.644 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:12:04.646 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:12:04.647 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 35.700926340000002, 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.649 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.650 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.651 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.652 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 27.313797379, 2024-04-26T12:12:04.653 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.654 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.655 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.658 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279510 5.a 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4522048180000002, 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.054251191999999997, 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279510 2024-04-26T12:12:04.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136124+0000", 2024-04-26T12:12:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136127+0000", 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.616e-06 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136133+0000", 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136138+0000", 2024-04-26T12:12:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1719999999999998e-06 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138045+0000", 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001906951 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138189+0000", 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014377899999999999 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138303+0000", 2024-04-26T12:12:04.662 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113818 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140841+0000", 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025384349999999999 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190315+0000", 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049474016000000003 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190343+0000", 2024-04-26T12:12:04.663 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7670000000000001e-05 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190376+0000", 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2861999999999998e-05 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279512 5.a 5:506620c5:::benchmark_data_smithi045_43640_object131138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4510564270000001, 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053205386, 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279512 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137272+0000", 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137277+0000", 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137285+0000", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137291+0000", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.84e-06 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139486+0000", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021944460000000001 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139576+0000", 2024-04-26T12:12:04.667 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0016e-05 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139661+0000", 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4876999999999994e-05 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140848+0000", 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011877789999999999 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.668 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190405+0000", 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049556986999999997 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190444+0000", 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8711999999999998e-05 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190478+0000", 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4437999999999998e-05 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279513 5.a 5:56a75d68:::benchmark_data_smithi045_43640_object131139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4495600319999999, 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051809704999999998, 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279513 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138773+0000", 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1150000000000004e-06 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138782+0000", 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8659999999999995e-06 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138788+0000", 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6710000000000004e-06 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140872+0000", 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002084757 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141001+0000", 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012882900000000001 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141128+0000", 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012668799999999999 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145398+0000", 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042697710000000003 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190512+0000", 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.045114639999999998 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190550+0000", 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7351999999999997e-05 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190579+0000", 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9611000000000002e-05 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279516 5.a 5:56b1c475:::benchmark_data_smithi045_43640_object131142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4473361669999996, 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.052473375000000003, 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.675 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279516 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140997+0000", 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141009+0000", 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1697e-05 2024-04-26T12:12:04.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141015+0000", 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3339999999999998e-06 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142442+0000", 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001426166 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142531+0000", 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9800000000000001e-05 2024-04-26T12:12:04.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142609+0000", 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7585999999999999e-05 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146926+0000", 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043168249999999998 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193382+0000", 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046456467000000001 2024-04-26T12:12:04.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193430+0000", 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7508e-05 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193467+0000", 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7015999999999999e-05 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.680 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279518 5.a 5:57f8d5df:::benchmark_data_smithi045_43640_object131144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4459782390000004, 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051251170999999998, 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279518 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.681 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142353+0000", 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2709999999999999e-06 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142362+0000", 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1200000000000008e-06 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142366+0000", 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8130000000000002e-06 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143469+0000", 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001103 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143546+0000", 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6816000000000005e-05 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143611+0000", 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5492000000000002e-05 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146930+0000", 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033186999999999999 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193518+0000", 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046587564999999997 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193564+0000", 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6090000000000001e-05 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.685 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193602+0000", 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8800000000000001e-05 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279519 5.a 5:55c308c1:::benchmark_data_smithi045_43640_object131145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4457270920000003, 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051119220999999999, 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279519 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.687 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142606+0000", 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2769999999999999e-06 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142616+0000", 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7259999999999997e-06 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142623+0000", 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144446+0000", 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001823627 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144542+0000", 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.556e-05 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144607+0000", 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5412000000000003e-05 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146934+0000", 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023270040000000001 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193638+0000", 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046703421000000002 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193681+0000", 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3409999999999999e-05 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193722+0000", 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0466999999999997e-05 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279521 5.a 5:5bb84d9c:::benchmark_data_smithi045_43640_object131147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.691 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 5.4456495089999999, 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053246825999999997, 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279521 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142679+0000", 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142683+0000", 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6229999999999999e-06 2024-04-26T12:12:04.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142691+0000", 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1270000000000003e-06 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142697+0000", 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3389999999999998e-06 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145438+0000", 2024-04-26T12:12:04.694 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027404679999999998 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145515+0000", 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6913e-05 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145587+0000", 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2484000000000006e-05 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146938+0000", 2024-04-26T12:12:04.695 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013503390000000001 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195863+0000", 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.048925457999999998 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195890+0000", 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7158999999999999e-05 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195927+0000", 2024-04-26T12:12:04.696 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6569000000000002e-05 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:281444 5.6 5:6edbfc9d:::benchmark_data_smithi045_43640_object133070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 4.7259664350000001, 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022540986999999998, 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.697 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 281444 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:04.698 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862366+0000", 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862374+0000", 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2430000000000005e-06 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.699 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862380+0000", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.173e-06 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.867290+0000", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049099920000000002 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.871681+0000", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004390489 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884771+0000", 2024-04-26T12:12:04.700 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013090421 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884824+0000", 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2766000000000003e-05 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884904+0000", 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9946999999999999e-05 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:04.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:04.702 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:04.703 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:04.701+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:04.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:04.804 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:04.803+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:04.889 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295032 5.0 5:0e4d9ab2:::benchmark_data_smithi045_43640_object146658:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.879553+0000", 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0081614570000000004, 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0081817799999999996, 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295032 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879553+0000", 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879553+0000", 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879553+0000", 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879556+0000", 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.371e-06 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879564+0000", 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3799999999999996e-06 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879569+0000", 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.541e-06 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.892 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.881288+0000", 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017188360000000001 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.881405+0000", 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011667600000000001 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.881510+0000", 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000105171 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.893 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885024+0000", 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0035138050000000001 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295034 5.8 5:1dc6431a:::benchmark_data_smithi045_43640_object146660:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.879709+0000", 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0080054410000000003, 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0080791820000000007, 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.894 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295034 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879709+0000", 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879709+0000", 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879709+0000", 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879714+0000", 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.344e-06 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879722+0000", 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.405e-06 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.896 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.879729+0000", 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.881729+0000", 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0019994309999999999 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.881799+0000", 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0504000000000001e-05 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.897 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.881870+0000", 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0987000000000003e-05 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885028+0000", 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031575190000000001 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295040 5.0 5:0e80437a:::benchmark_data_smithi045_43640_object146666:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.898 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.882594+0000", 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0051205319999999997, 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052510600000000001, 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295040 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.882594+0000", 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.882594+0000", 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.882594+0000", 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.882596+0000", 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2709999999999999e-06 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.900 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.882603+0000", 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9e-06 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.882608+0000", 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.989e-06 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883242+0000", 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00063426800000000001 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.901 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883337+0000", 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.4618999999999997e-05 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883411+0000", 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3880000000000004e-05 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886219+0000", 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0028080599999999998 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295041 5.b 5:d8004ddd:::benchmark_data_smithi045_43640_object146667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.883923+0000", 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0037916629999999998, 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0039679989999999998, 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295041 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.903 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883923+0000", 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883923+0000", 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883922+0000", 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883928+0000", 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2379999999999997e-06 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883938+0000", 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0485999999999999e-05 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883945+0000", 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8940000000000004e-06 2024-04-26T12:12:04.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.883985+0000", 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0491000000000002e-05 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884103+0000", 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011773300000000001 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884206+0000", 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000103377 2024-04-26T12:12:04.906 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886252+0000", 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020459710000000002 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295045 5.4 5:24579770:::benchmark_data_smithi045_43640_object146671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.884109+0000", 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0036057340000000002, 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0038253079999999999, 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.907 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295045 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884109+0000", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884109+0000", 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884109+0000", 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884111+0000", 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1330000000000002e-06 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884116+0000", 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.648e-06 2024-04-26T12:12:04.909 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884121+0000", 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.5929999999999999e-06 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884155+0000", 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3586e-05 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884262+0000", 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000107602 2024-04-26T12:12:04.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.884373+0000", 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000110481 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295046 5.4 5:26eb0f72:::benchmark_data_smithi045_43640_object146672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.885848+0000", 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0018669450000000001, 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0021390369999999999, 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.911 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295046 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885848+0000", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885848+0000", 2024-04-26T12:12:04.912 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885847+0000", 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885852+0000", 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4879999999999998e-06 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885862+0000", 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3810000000000005e-06 2024-04-26T12:12:04.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.885869+0000", 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0509999999999999e-06 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886237+0000", 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00036833500000000002 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886357+0000", 2024-04-26T12:12:04.914 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119306 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886423+0000", 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6802000000000002e-05 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295048 5.f 5:fb87c94d:::benchmark_data_smithi045_43640_object146674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.886183+0000", 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001531955, 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00189354, 2024-04-26T12:12:04.915 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295048 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886183+0000", 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.916 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886183+0000", 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886182+0000", 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886187+0000", 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6380000000000003e-06 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.917 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886195+0000", 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7620000000000001e-06 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886202+0000", 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8759999999999999e-06 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886295+0000", 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2441999999999993e-05 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.918 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886412+0000", 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000117707 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295049 5.9 5:91af36c1:::benchmark_data_smithi045_43640_object146675:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.886225+0000", 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.0014897179999999999, 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001908533, 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.919 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295049 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886225+0000", 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886225+0000", 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.920 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886224+0000", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886228+0000", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2990000000000001e-06 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886235+0000", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8159999999999996e-06 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.921 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886241+0000", 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.2809999999999997e-06 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886271+0000", 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0482000000000001e-05 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886392+0000", 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012019900000000001 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295052 5.8 5:179d300d:::benchmark_data_smithi045_43640_object146678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.886250+0000", 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 0.001464361, 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001929776, 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295052 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.923 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886250+0000", 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886250+0000", 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886250+0000", 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.924 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886252+0000", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4210000000000002e-06 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886258+0000", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.8309999999999997e-06 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886264+0000", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6239999999999999e-06 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.925 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886297+0000", 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3377000000000002e-05 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886406+0000", 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000108525 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.886507+0000", 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010081000000000001 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.926 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:295054 5.0 5:0d49ee2e:::benchmark_data_smithi045_43640_object146680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.887973+0000", 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.999742, 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026017299999999999, 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 295054 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.927 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887973+0000", 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887973+0000", 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887972+0000", 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.928 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887977+0000", 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6929999999999998e-06 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887984+0000", 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.6159999999999996e-06 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887991+0000", 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9700000000000002e-06 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.929 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888033+0000", 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1637000000000001e-05 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888136+0000", 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000102921 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888211+0000", 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.5566000000000001e-05 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.930 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:295032 5.0 e58/17)", 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.887995+0000", 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9997196, 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000291935, 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887995+0000", 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.931 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887995+0000", 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887995+0000", 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.887997+0000", 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.855e-06 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.932 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888002+0000", 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2460000000000003e-06 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888006+0000", 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0899999999999998e-06 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:295034 5.8 e58/17)", 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.888056+0000", 2024-04-26T12:12:04.933 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9996591, 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00025871500000000002, 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888056+0000", 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888056+0000", 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888055+0000", 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888058+0000", 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.4080000000000001e-06 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.935 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888064+0000", 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.3899999999999998e-06 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888068+0000", 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.16e-06 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:295040 5.0 e58/17)", 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:12:04.888072+0000", 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 4294967295.9996424, 2024-04-26T12:12:04.936 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00027690499999999998, 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "queued for pg", 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888072+0000", 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888072+0000", 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.937 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888072+0000", 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888074+0000", 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.8300000000000001e-06 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888079+0000", 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9899999999999997e-06 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:04.938 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:12:04.888083+0000", 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7979999999999999e-06 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 13 2024-04-26T12:12:04.939 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:04.940 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:04.938+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:04.941 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:05.043 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:05.041+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:05.144 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:05.142+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:05.163 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:05.163 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:05.163 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:12:05.164 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:12:05.164 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:05.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:05.243 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:05.242+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:05.344 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:05.342+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:05.362 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.891003351999998, 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:12:05.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.367 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.889388108999995, 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.368 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:12:05.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:12:05.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:12:05.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:05.373 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.972972501000001, 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:12:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:12:05.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:12:05.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.378 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.878292920999996, 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:12:05.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:12:05.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.384 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.873085149999994, 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:05.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:12:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.869886191999996, 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.390 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:12:05.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:05.395 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.869634383999994, 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:05.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:12:05.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:12:05.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:12:05.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:12:05.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 75.866978345999996, 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.401 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.406 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 54.313075529000002, 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:12:05.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:12:05.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:12:05.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:12:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 54.312966912, 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:12:05.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:05.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:12:05.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:12:05.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:05.417 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 54.312558369000001, 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:12:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:12:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279494 5.4 5:2a8017ae:::benchmark_data_smithi045_43640_object131120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2281664159999996, 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051192274000000003, 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279494 2024-04-26T12:12:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131183+0000", 2024-04-26T12:12:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131186+0000", 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131191+0000", 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.425 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131196+0000", 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132978+0000", 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017828 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133071+0000", 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2901999999999999e-05 2024-04-26T12:12:05.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133138+0000", 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6734000000000002e-05 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138348+0000", 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052102620000000002 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182262+0000", 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043913229999999998 2024-04-26T12:12:05.427 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182329+0000", 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7359000000000003e-05 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182376+0000", 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.428 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279498 5.4 5:2608519e:::benchmark_data_smithi045_43640_object131124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2267565539999996, 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.052255791000000003, 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279498 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:05.429 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132593+0000", 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132598+0000", 2024-04-26T12:12:05.430 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132608+0000", 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0302999999999999e-05 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132615+0000", 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134454+0000", 2024-04-26T12:12:05.431 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018386889999999999 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134561+0000", 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106913 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134662+0000", 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010153399999999999 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138369+0000", 2024-04-26T12:12:05.432 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003706539 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184744+0000", 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046375223 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184794+0000", 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184849+0000", 2024-04-26T12:12:05.433 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279503 5.4 5:2991e931:::benchmark_data_smithi045_43640_object131129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2252782480000004, 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050896601999999999, 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.434 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279503 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134071+0000", 2024-04-26T12:12:05.435 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134076+0000", 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134083+0000", 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3270000000000003e-06 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134088+0000", 2024-04-26T12:12:05.436 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136107+0000", 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020195640000000002 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136204+0000", 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6837999999999997e-05 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.437 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136272+0000", 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8064000000000004e-05 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182395+0000", 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046122877 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184893+0000", 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024983129999999998 2024-04-26T12:12:05.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184933+0000", 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9178999999999999e-05 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184969+0000", 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279509 5.4 5:26e9e343:::benchmark_data_smithi045_43640_object131135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2231897900000002, 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.048926960999999998, 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279509 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.440 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.441 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136164+0000", 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136171+0000", 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9210000000000003e-06 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136176+0000", 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9660000000000004e-06 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.442 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137327+0000", 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011509339999999999 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137395+0000", 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7609999999999998e-05 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137477+0000", 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2826999999999998e-05 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184683+0000", 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047205812 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185010+0000", 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00032656599999999998 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185051+0000", 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0754000000000003e-05 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.444 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185087+0000", 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6859000000000001e-05 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279511 5.4 5:22bd527c:::benchmark_data_smithi045_43640_object131137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2224846700000001, 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050522629999999999, 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.445 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279511 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136865+0000", 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136874+0000", 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.447 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136882+0000", 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136888+0000", 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182428+0000", 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045540663000000002 2024-04-26T12:12:05.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182556+0000", 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127584 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182672+0000", 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116533 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187058+0000", 2024-04-26T12:12:05.450 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043857310000000004 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187325+0000", 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026685000000000001 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187350+0000", 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5449999999999999e-05 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187388+0000", 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7766999999999999e-05 2024-04-26T12:12:05.451 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279494 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2222198019999997, 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045266883000000001, 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:05.452 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.453 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137132+0000", 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3549999999999999e-06 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137135+0000", 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9239999999999999e-06 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137137+0000", 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1969999999999999e-06 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.454 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138497+0000", 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013601080000000001 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138504+0000", 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182397+0000", 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043893518999999999 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:279510 5.a e56/17 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head v 56'17341, mlcod=56'17337)", 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.220924611, 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051831733999999997, 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.456 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138425+0000", 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138430+0000", 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.096e-06 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138438+0000", 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138444+0000", 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138474+0000", 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0001e-05 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.458 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138498+0000", 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3572999999999999e-05 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190236+0000", 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051737981000000002 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190257+0000", 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1795000000000001e-05 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.459 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279498 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.220857605, 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046365244999999999, 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138492+0000", 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138496+0000", 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:12:05.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138503+0000", 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138508+0000", 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184722+0000", 2024-04-26T12:12:05.462 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046214098000000002 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184731+0000", 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184858+0000", 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012661700000000001 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.463 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279514 5.0 5:008c068a:::benchmark_data_smithi045_43640_object131140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 6.2194710139999998, 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047241290999999998, 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279514 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139878+0000", 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139883+0000", 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3950000000000003e-06 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182261+0000", 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.042377807000000003 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182281+0000", 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9851e-05 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:05.466 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182332+0000", 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1597000000000001e-05 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182479+0000", 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014700100000000001 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182613+0000", 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013436899999999999 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:05.467 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184655+0000", 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020416449999999999 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187055+0000", 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024002049999999999 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187083+0000", 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7702999999999999e-05 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:05.468 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187120+0000", 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7449e-05 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:05.469 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:05.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:12:05.471 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Removed 148371 objects 2024-04-26T12:12:05.472 INFO:tasks.radosbench.radosbench.0.smithi045.stdout:Clean up completed and total clean up time :52.8454 2024-04-26T12:12:05.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:05.472 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:05.469+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:05.571 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:05.570+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:05.600 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:12:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 0 2024-04-26T12:12:05.601 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:05.611 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:05.673 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:05.671+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:05.682 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:12:05.702 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:12:05.703 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:12:05.703 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:12:05.703 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:12:05.705 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:12:05.706 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:12:05.739 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:05.739 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:05.749 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:05.774 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:05.773+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:05.875 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:05.874+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:05.875 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:05.876 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:05.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:05.976 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:05.975+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:06.014 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.014 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.025 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:06.077 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:06.076+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:06.152 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.153 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:06.178 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:06.177+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:06.279 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:06.278+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:06.295 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:12:06.332 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.332 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.342 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:06.381 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:06.380+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:06.470 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.470 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.480 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:06.482 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:06.480+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:06.583 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:06.582+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:06.607 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.608 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:06.683 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:06.681+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:06.745 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.745 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.756 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:06.797 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:06.795+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:06.885 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:06.885 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:06.886 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:06.884+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:06.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:06.987 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:06.986+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:07.064 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:07.064 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:07.074 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:07.091 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:07.090+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:07.192 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:07.190+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:07.242 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:07.242 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:07.253 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:07.292 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:07.291+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:07.293 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:12:07.383 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:07.384 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:07.393 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:07.391+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:07.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:07.494 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:07.492+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:07.561 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:07.561 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:07.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:07.595 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:07.594+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:07.695 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:07.693+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:07.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:12:07.739 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:07.740 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:07.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:07.796 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:07.795+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:07.879 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:12:07.880 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:07.880 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:07.880 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 0 2024-04-26T12:12:07.880 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:07.890 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:07.897 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:07.895+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:07.901 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:12:07.901 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:12:07.901 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:12:07.901 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:12:07.904 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:12:07.904 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:12:07.997 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:07.996+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:08.058 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:08.058 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:08.058 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:12:08.058 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:12:08.058 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:08.068 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:08.099 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:08.097+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:08.200 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:08.199+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 82.767867515000006, 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.239 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.241 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.242 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:12:08.243 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.244 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 82.766252272000003, 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.245 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:12:08.247 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:12:08.248 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:12:08.249 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:12:08.250 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.849836663999994, 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.251 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.252 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.253 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.254 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.255 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.755157084000004, 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:08.257 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:12:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:12:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:12:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:12:08.261 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.749949313000002, 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.262 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.263 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.264 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.265 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:12:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.746750355000003, 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.269 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.270 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.271 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.272 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.746498547000002, 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.273 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:12:08.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.277 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 78.743842509000004, 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.279 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.280 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.282 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.283 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.189939692000003, 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.284 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.285 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.286 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.287 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.288 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.189831075000001, 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:12:08.291 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:12:08.292 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:12:08.293 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.294 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 57.189422532000002, 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.295 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.296 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.297 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.298 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.299 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279494 5.4 5:2a8017ae:::benchmark_data_smithi045_43640_object131120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:08.300 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1050305789999992, 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051192274000000003, 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279494 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.301 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131183+0000", 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131186+0000", 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.302 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131191+0000", 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131196+0000", 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132978+0000", 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017828 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.303 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133071+0000", 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2901999999999999e-05 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133138+0000", 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6734000000000002e-05 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138348+0000", 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052102620000000002 2024-04-26T12:12:08.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182262+0000", 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043913229999999998 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182329+0000", 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7359000000000003e-05 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182376+0000", 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:12:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279498 5.4 5:2608519e:::benchmark_data_smithi045_43640_object131124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1036207170000001, 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.052255791000000003, 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279498 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132593+0000", 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132598+0000", 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132608+0000", 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0302999999999999e-05 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.308 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132615+0000", 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134454+0000", 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018386889999999999 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134561+0000", 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106913 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.309 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134662+0000", 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010153399999999999 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138369+0000", 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003706539 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184744+0000", 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046375223 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.310 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184794+0000", 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184849+0000", 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279503 5.4 5:2991e931:::benchmark_data_smithi045_43640_object131129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:08.311 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1021424110000009, 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050896601999999999, 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279503 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.312 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134071+0000", 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134076+0000", 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134083+0000", 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3270000000000003e-06 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134088+0000", 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136107+0000", 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020195640000000002 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136204+0000", 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6837999999999997e-05 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136272+0000", 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8064000000000004e-05 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182395+0000", 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046122877 2024-04-26T12:12:08.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184893+0000", 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024983129999999998 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184933+0000", 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9178999999999999e-05 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184969+0000", 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:12:08.316 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279509 5.4 5:26e9e343:::benchmark_data_smithi045_43640_object131135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.1000539529999998, 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.048926960999999998, 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.317 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279509 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136164+0000", 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136171+0000", 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9210000000000003e-06 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136176+0000", 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9660000000000004e-06 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137327+0000", 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011509339999999999 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137395+0000", 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7609999999999998e-05 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137477+0000", 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2826999999999998e-05 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184683+0000", 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047205812 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185010+0000", 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00032656599999999998 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185051+0000", 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0754000000000003e-05 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185087+0000", 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6859000000000001e-05 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279511 5.4 5:22bd527c:::benchmark_data_smithi045_43640_object131137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:08.322 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.0993488330000005, 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050522629999999999, 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279511 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136865+0000", 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136874+0000", 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136882+0000", 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136888+0000", 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182428+0000", 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045540663000000002 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182556+0000", 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127584 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182672+0000", 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116533 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187058+0000", 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043857310000000004 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187325+0000", 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026685000000000001 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187350+0000", 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5449999999999999e-05 2024-04-26T12:12:08.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187388+0000", 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7766999999999999e-05 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279494 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.0990839650000002, 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045266883000000001, 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.328 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:08.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137132+0000", 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3549999999999999e-06 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137135+0000", 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9239999999999999e-06 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137137+0000", 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1969999999999999e-06 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138497+0000", 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013601080000000001 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138504+0000", 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182397+0000", 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043893518999999999 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:279510 5.a e56/17 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head v 56'17341, mlcod=56'17337)", 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.0977887739999996, 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051831733999999997, 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.332 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138425+0000", 2024-04-26T12:12:08.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138430+0000", 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.096e-06 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138438+0000", 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138444+0000", 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138474+0000", 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0001e-05 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138498+0000", 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3572999999999999e-05 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190236+0000", 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051737981000000002 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190257+0000", 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1795000000000001e-05 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279498 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.0977217679999995, 2024-04-26T12:12:08.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046365244999999999, 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138492+0000", 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138496+0000", 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138503+0000", 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:12:08.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138508+0000", 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184722+0000", 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046214098000000002 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184731+0000", 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:12:08.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184858+0000", 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012661700000000001 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279514 5.0 5:008c068a:::benchmark_data_smithi045_43640_object131140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 9.0963351770000003, 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047241290999999998, 2024-04-26T12:12:08.340 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279514 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:08.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139878+0000", 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139883+0000", 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3950000000000003e-06 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:08.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182261+0000", 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.042377807000000003 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182281+0000", 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9851e-05 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182332+0000", 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1597000000000001e-05 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182479+0000", 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014700100000000001 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182613+0000", 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013436899999999999 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184655+0000", 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020416449999999999 2024-04-26T12:12:08.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187055+0000", 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024002049999999999 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187083+0000", 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7702999999999999e-05 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187120+0000", 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7449e-05 2024-04-26T12:12:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.346 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.346 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.346 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:08.346 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:08.346 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:08.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:08.349 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:08.346+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:08.448 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:08.447+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:08.477 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:08.477 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:12:08.478 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 0 2024-04-26T12:12:08.478 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:08.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:08.549 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:08.548+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:08.614 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:08.615 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:12:08.615 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:12:08.615 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:12:08.615 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:08.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:08.650 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:08.648+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:08.750 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:08.748+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:08.754 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 88.774788365999996, 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:12:08.756 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:12:08.757 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:12:08.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:12:08.759 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:12:08.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.760 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.760 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:12:08.760 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:12:08.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.761 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 83.283599335000005, 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:12:08.762 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.763 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:12:08.765 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:12:08.766 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.767 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 83.281247958999998, 2024-04-26T12:12:08.768 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.769 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.770 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:12:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.268149675999993, 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:12:08.775 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:12:08.776 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.777 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:08.778 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.264894698999996, 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.779 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:12:08.780 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.781 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:12:08.782 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.262397023999995, 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.783 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.784 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:12:08.785 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.786 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.787 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.261713723, 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.788 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:12:08.790 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.791 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.792 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 79.259593206999995, 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.793 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.794 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.795 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:12:08.796 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.797 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 57.698929790000001, 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:08.798 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:12:08.799 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:12:08.800 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.801 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 48.718661312999998, 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:12:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.805 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.806 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.807 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 39.864163447999999, 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:08.808 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:12:08.809 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.810 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:12:08.811 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 31.477034487000001, 2024-04-26T12:12:08.812 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.813 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:12:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.815 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.816 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.817 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279510 5.a 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6154419260000008, 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.054251191999999997, 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.818 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279510 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:08.819 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136124+0000", 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136127+0000", 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.616e-06 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.820 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136133+0000", 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136138+0000", 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1719999999999998e-06 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138045+0000", 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001906951 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138189+0000", 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014377899999999999 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138303+0000", 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113818 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140841+0000", 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025384349999999999 2024-04-26T12:12:08.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190315+0000", 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049474016000000003 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190343+0000", 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7670000000000001e-05 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190376+0000", 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2861999999999998e-05 2024-04-26T12:12:08.823 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279512 5.a 5:506620c5:::benchmark_data_smithi045_43640_object131138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6142935349999998, 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053205386, 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.824 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279512 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.825 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137272+0000", 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137277+0000", 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137285+0000", 2024-04-26T12:12:08.826 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137291+0000", 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.84e-06 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139486+0000", 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021944460000000001 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.827 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139576+0000", 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0016e-05 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139661+0000", 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4876999999999994e-05 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140848+0000", 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011877789999999999 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190405+0000", 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049556986999999997 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190444+0000", 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8711999999999998e-05 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190478+0000", 2024-04-26T12:12:08.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4437999999999998e-05 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279513 5.a 5:56a75d68:::benchmark_data_smithi045_43640_object131139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6127971399999996, 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051809704999999998, 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.830 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279513 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138773+0000", 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1150000000000004e-06 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138782+0000", 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8659999999999995e-06 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138788+0000", 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6710000000000004e-06 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140872+0000", 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002084757 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141001+0000", 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012882900000000001 2024-04-26T12:12:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141128+0000", 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012668799999999999 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145398+0000", 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042697710000000003 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190512+0000", 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.045114639999999998 2024-04-26T12:12:08.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190550+0000", 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7351999999999997e-05 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190579+0000", 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9611000000000002e-05 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279516 5.a 5:56b1c475:::benchmark_data_smithi045_43640_object131142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6105732750000001, 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.052473375000000003, 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279516 2024-04-26T12:12:08.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.837 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140997+0000", 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141009+0000", 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1697e-05 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.838 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141015+0000", 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3339999999999998e-06 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142442+0000", 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001426166 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142531+0000", 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9800000000000001e-05 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142609+0000", 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7585999999999999e-05 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146926+0000", 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043168249999999998 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193382+0000", 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046456467000000001 2024-04-26T12:12:08.840 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193430+0000", 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7508e-05 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193467+0000", 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7015999999999999e-05 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.841 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279518 5.a 5:57f8d5df:::benchmark_data_smithi045_43640_object131144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6092153469999992, 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051251170999999998, 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279518 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.842 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:08.843 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142353+0000", 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2709999999999999e-06 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142362+0000", 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1200000000000008e-06 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.844 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142366+0000", 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8130000000000002e-06 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143469+0000", 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001103 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143546+0000", 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6816000000000005e-05 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.845 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143611+0000", 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5492000000000002e-05 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146930+0000", 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033186999999999999 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193518+0000", 2024-04-26T12:12:08.846 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046587564999999997 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193564+0000", 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6090000000000001e-05 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193602+0000", 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8800000000000001e-05 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.847 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279519 5.a 5:55c308c1:::benchmark_data_smithi045_43640_object131145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6089641999999991, 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051119220999999999, 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279519 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.848 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.849 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142606+0000", 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2769999999999999e-06 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142616+0000", 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7259999999999997e-06 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142623+0000", 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:12:08.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144446+0000", 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001823627 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144542+0000", 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.556e-05 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144607+0000", 2024-04-26T12:12:08.851 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5412000000000003e-05 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146934+0000", 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023270040000000001 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193638+0000", 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046703421000000002 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.852 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193681+0000", 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3409999999999999e-05 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193722+0000", 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0466999999999997e-05 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.853 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279521 5.a 5:5bb84d9c:::benchmark_data_smithi045_43640_object131147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 9.6088866169999996, 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053246825999999997, 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279521 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.854 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142679+0000", 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.855 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142683+0000", 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6229999999999999e-06 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142691+0000", 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1270000000000003e-06 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142697+0000", 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3389999999999998e-06 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.856 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145438+0000", 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027404679999999998 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145515+0000", 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6913e-05 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145587+0000", 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2484000000000006e-05 2024-04-26T12:12:08.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146938+0000", 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013503390000000001 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195863+0000", 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.048925457999999998 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195890+0000", 2024-04-26T12:12:08.858 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7158999999999999e-05 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195927+0000", 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6569000000000002e-05 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:281444 5.6 5:6edbfc9d:::benchmark_data_smithi045_43640_object133070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:08.859 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 8.8892035430000007, 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022540986999999998, 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 281444 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:08.860 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862366+0000", 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862374+0000", 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2430000000000005e-06 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:08.862 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862380+0000", 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.173e-06 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.867290+0000", 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049099920000000002 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.871681+0000", 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004390489 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884771+0000", 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013090421 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884824+0000", 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2766000000000003e-05 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884904+0000", 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9946999999999999e-05 2024-04-26T12:12:08.864 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.865 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:08.865 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:08.865 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:08.866 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:08.865+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:08.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:08.966 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:08.964+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:08.995 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:08.995 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:08.995 INFO:teuthology.orchestra.run.smithi094.stdout: "num_ops": 0 2024-04-26T12:12:08.996 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:09.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:09.068 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:09.066+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:09.133 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:09.133 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [], 2024-04-26T12:12:09.133 INFO:teuthology.orchestra.run.smithi094.stdout: "complaint_time": 30, 2024-04-26T12:12:09.133 INFO:teuthology.orchestra.run.smithi094.stdout: "num_blocked_ops": 0 2024-04-26T12:12:09.133 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:09.143 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:09.185 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:09.183+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:09.270 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:09.268+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:09.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: "size": 20, 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 600, 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: "ops": [ 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87779 5.4 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:09.313 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 83.842470315, 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.02470518, 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87779 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:09.314 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468347+0000", 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468346+0000", 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.315 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468382+0000", 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5822999999999999e-05 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468392+0000", 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5219999999999996e-06 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.468399+0000", 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3180000000000001e-06 2024-04-26T12:12:09.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470080+0000", 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00168082 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470159+0000", 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9511999999999994e-05 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470246+0000", 2024-04-26T12:12:09.317 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.6267000000000006e-05 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.473398+0000", 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0031525350000000001 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.492990+0000", 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.019591399999999998 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.318 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493019+0000", 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493052+0000", 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3349999999999997e-05 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:87780 5.4 5:245cddcd:::benchmark_data_smithi045_43640_object87779:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:09.319 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 83.840855071999997, 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023189161999999999, 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 87780 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.320 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469962+0000", 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.469961+0000", 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.321 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470046+0000", 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470055+0000", 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.3209999999999994e-06 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.322 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.470062+0000", 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471678+0000", 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001615607 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471798+0000", 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000119813 2024-04-26T12:12:09.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.471903+0000", 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000104935 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.475052+0000", 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003149331 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.324 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493086+0000", 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018034458999999999 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493117+0000", 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:45.493151+0000", 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4465999999999998e-05 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.325 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96725 5.b 5:dd82780a:::benchmark_data_smithi045_43640_object96724:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.924439464000002, 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024646478999999999, 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96725 2024-04-26T12:12:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386378+0000", 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.327 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386377+0000", 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386433+0000", 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5402000000000003e-05 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386441+0000", 2024-04-26T12:12:09.328 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.0590000000000003e-06 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.386447+0000", 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.1829999999999999e-06 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388699+0000", 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0022525869999999999 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.329 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.388813+0000", 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000113948 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.389186+0000", 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00037246499999999999 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.392629+0000", 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0034436430000000001 2024-04-26T12:12:09.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.410973+0000", 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018343893999999999 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411001+0000", 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.8110999999999999e-05 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.411024+0000", 2024-04-26T12:12:09.331 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2717999999999998e-05 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96923 5.e 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.829759883999998, 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.028400011999999999, 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.332 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96923 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.333 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481057+0000", 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481138+0000", 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.1508999999999995e-05 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481148+0000", 2024-04-26T12:12:09.334 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6800000000000005e-06 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481154+0000", 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0190000000000003e-06 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481191+0000", 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7441999999999998e-05 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481329+0000", 2024-04-26T12:12:09.335 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013779499999999999 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.481472+0000", 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014316399999999999 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486071+0000", 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0045984930000000004 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509397+0000", 2024-04-26T12:12:09.336 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023325776999999999 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509430+0000", 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.3841999999999999e-05 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509457+0000", 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.6831000000000001e-05 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.337 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96936 5.e 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.824552112999996, 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023319815000000001, 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96936 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.338 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486265+0000", 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486264+0000", 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.339 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486325+0000", 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0375999999999999e-05 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486342+0000", 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.7476999999999999e-05 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486347+0000", 2024-04-26T12:12:09.340 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1850000000000003e-06 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486387+0000", 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0077999999999998e-05 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486538+0000", 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015042000000000001 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.341 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.486640+0000", 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010168 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.488997+0000", 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0023574109999999998 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509497+0000", 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020500391999999999 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.342 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509548+0000", 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1020000000000003e-05 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.509585+0000", 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6448000000000001e-05 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96943 5.e 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.821353154999997, 2024-04-26T12:12:09.343 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029746014000000001, 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96943 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.344 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489464+0000", 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489463+0000", 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489515+0000", 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1603e-05 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.345 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489522+0000", 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489530+0000", 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.7139999999999993e-06 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489568+0000", 2024-04-26T12:12:09.346 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8352999999999997e-05 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489678+0000", 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000109498 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489822+0000", 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014435399999999999 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.347 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493840+0000", 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0040181130000000002 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519160+0000", 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.025319529 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519189+0000", 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9692999999999998e-05 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.348 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519210+0000", 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.0758999999999999e-05 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96944 5.e 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.821101346999995, 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.029603543999999999, 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.349 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96944 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489716+0000", 2024-04-26T12:12:09.350 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489715+0000", 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489789+0000", 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4218e-05 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.351 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489797+0000", 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2719999999999997e-06 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.489804+0000", 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7259999999999996e-06 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491679+0000", 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018748619999999999 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491796+0000", 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00011736200000000001 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.491938+0000", 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014193800000000001 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.495638+0000", 2024-04-26T12:12:09.353 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0037000929999999998 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519244+0000", 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023606022000000001 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519284+0000", 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9060000000000002e-05 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.354 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519319+0000", 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5800000000000003e-05 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:96950 5.e 5:706d69ea:::benchmark_data_smithi045_43640_object96949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 79.818445308999998, 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.027060345, 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.355 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 96950 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492372+0000", 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.356 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492371+0000", 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492419+0000", 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.744e-05 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492427+0000", 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.4549999999999995e-06 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.357 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.492432+0000", 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0930000000000002e-06 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493867+0000", 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001434495 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.493988+0000", 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012129900000000001 2024-04-26T12:12:09.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.494142+0000", 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00015394900000000001 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.496034+0000", 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018924510000000001 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519370+0000", 2024-04-26T12:12:09.359 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023336171999999999 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519400+0000", 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9077e-05 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:10:49.519432+0000", 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.2631e-05 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.360 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144968 5.4 5:21a1bd75:::benchmark_data_smithi045_43640_object144967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 58.264542491999997, 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023299279999999999, 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144968 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.361 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046275+0000", 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046274+0000", 2024-04-26T12:12:09.362 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046362+0000", 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7955999999999996e-05 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.363 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046367+0000", 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.2630000000000003e-06 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046371+0000", 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.8929999999999998e-06 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046394+0000", 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2657999999999999e-05 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.364 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046482+0000", 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8096999999999994e-05 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046566+0000", 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3891e-05 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050995+0000", 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0044288640000000002 2024-04-26T12:12:09.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069515+0000", 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018520116 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069551+0000", 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6226000000000002e-05 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069574+0000", 2024-04-26T12:12:09.366 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.2765999999999999e-05 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144971 5.4 5:25843963:::benchmark_data_smithi045_43640_object144970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 58.264433875000002, 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.023312411000000002, 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.367 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144971 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046383+0000", 2024-04-26T12:12:09.368 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046453+0000", 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.0766000000000007e-05 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046463+0000", 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.5230000000000001e-06 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046470+0000", 2024-04-26T12:12:09.369 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048230+0000", 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017591569999999999 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048364+0000", 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013423299999999999 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.048536+0000", 2024-04-26T12:12:09.370 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00017216900000000001 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050998+0000", 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.002461843 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069617+0000", 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.018619456999999999 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069662+0000", 2024-04-26T12:12:09.371 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4310000000000001e-05 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.069696+0000", 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.4168999999999998e-05 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:144976 5.4 5:21e985c9:::benchmark_data_smithi045_43640_object144975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 58.264025332000003, 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.024811440000000001, 2024-04-26T12:12:09.372 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 144976 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046792+0000", 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046791+0000", 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046852+0000", 2024-04-26T12:12:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.0797000000000001e-05 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046858+0000", 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.046862+0000", 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.1840000000000001e-06 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049872+0000", 2024-04-26T12:12:09.375 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0030098600000000001 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.049959+0000", 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7457e-05 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.050048+0000", 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.8305000000000002e-05 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.376 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.051366+0000", 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.001318598 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071538+0000", 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.020171431 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071576+0000", 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.807e-05 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.377 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:11.071603+0000", 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7585000000000001e-05 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279494 5.4 5:2a8017ae:::benchmark_data_smithi045_43640_object131120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.179633379, 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051192274000000003, 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.378 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279494 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131184+0000", 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131183+0000", 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131186+0000", 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131191+0000", 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.4419999999999997e-06 2024-04-26T12:12:09.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.131196+0000", 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132978+0000", 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0017828 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133071+0000", 2024-04-26T12:12:09.381 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2901999999999999e-05 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.133138+0000", 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.6734000000000002e-05 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138348+0000", 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0052102620000000002 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182262+0000", 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043913229999999998 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182329+0000", 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7359000000000003e-05 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182376+0000", 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.7095000000000002e-05 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279498 5.4 5:2608519e:::benchmark_data_smithi045_43640_object131124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.178223516999999, 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.052255791000000003, 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279498 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.384 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132594+0000", 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132593+0000", 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.385 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132598+0000", 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132608+0000", 2024-04-26T12:12:09.386 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.0302999999999999e-05 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.132615+0000", 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3769999999999998e-06 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134454+0000", 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0018386889999999999 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.387 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134561+0000", 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000106913 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134662+0000", 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00010153399999999999 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138369+0000", 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.003706539 2024-04-26T12:12:09.388 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184744+0000", 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046375223 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184794+0000", 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9509000000000003e-05 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184849+0000", 2024-04-26T12:12:09.389 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.5661000000000001e-05 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279503 5.4 5:2991e931:::benchmark_data_smithi045_43640_object131129:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.176745211, 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050896601999999999, 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.390 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279503 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134072+0000", 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.391 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134071+0000", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134076+0000", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.2520000000000001e-06 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134083+0000", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.3270000000000003e-06 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.392 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.134088+0000", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.899e-06 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136107+0000", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020195640000000002 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136204+0000", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.6837999999999997e-05 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136272+0000", 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.8064000000000004e-05 2024-04-26T12:12:09.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182395+0000", 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046122877 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184893+0000", 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024983129999999998 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184933+0000", 2024-04-26T12:12:09.394 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.9178999999999999e-05 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184969+0000", 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.5960000000000001e-05 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279509 5.4 5:26e9e343:::benchmark_data_smithi045_43640_object131135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.174656753000001, 2024-04-26T12:12:09.395 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.048926960999999998, 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279509 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.396 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136160+0000", 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136164+0000", 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.4340000000000002e-06 2024-04-26T12:12:09.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136171+0000", 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9210000000000003e-06 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136176+0000", 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.9660000000000004e-06 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137327+0000", 2024-04-26T12:12:09.398 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0011509339999999999 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137395+0000", 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.7609999999999998e-05 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137477+0000", 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.2826999999999998e-05 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.399 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184683+0000", 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047205812 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185010+0000", 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00032656599999999998 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185051+0000", 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.0754000000000003e-05 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.400 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.185087+0000", 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6859000000000001e-05 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279511 5.4 5:22bd527c:::benchmark_data_smithi045_43640_object131137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.173951633, 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.050522629999999999, 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.401 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279511 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136866+0000", 2024-04-26T12:12:09.402 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136865+0000", 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136874+0000", 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136882+0000", 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.136888+0000", 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.6060000000000002e-06 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182428+0000", 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045540663000000002 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.404 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182556+0000", 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000127584 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182672+0000", 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.000116533 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187058+0000", 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0043857310000000004 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.405 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187325+0000", 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00026685000000000001 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187350+0000", 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.5449999999999999e-05 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187388+0000", 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7766999999999999e-05 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279494 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.173686764999999, 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.045266883000000001, 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137130+0000", 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967296 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137132+0000", 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.3549999999999999e-06 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.408 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137135+0000", 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.9239999999999999e-06 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.137137+0000", 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1969999999999999e-06 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138497+0000", 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0013601080000000001 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.409 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138504+0000", 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182397+0000", 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.043893518999999999 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.410 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop(client.4719.0:279510 5.a e56/17 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head v 56'17341, mlcod=56'17337)", 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.172391574000001, 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051831733999999997, 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.411 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138426+0000", 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138425+0000", 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138430+0000", 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.096e-06 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.412 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138438+0000", 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 7.9400000000000002e-06 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138444+0000", 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138474+0000", 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.0001e-05 2024-04-26T12:12:09.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138498+0000", 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.3572999999999999e-05 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190236+0000", 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.051737981000000002 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.190257+0000", 2024-04-26T12:12:09.414 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.1795000000000001e-05 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_repop_reply(client.4719.0:279498 5.4 e56/17 ondisk, result = 0)", 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.172324568000001, 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046365244999999999, 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "started", 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.415 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138493+0000", 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138492+0000", 2024-04-26T12:12:09.416 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138496+0000", 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.6950000000000002e-06 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138503+0000", 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 6.9739999999999996e-06 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.138508+0000", 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184722+0000", 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.046214098000000002 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184731+0000", 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 9.2699999999999993e-06 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.418 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184858+0000", 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00012661700000000001 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "description": "osd_op(client.4719.0:279514 5.0 5:008c068a:::benchmark_data_smithi045_43640_object131140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "initiated_at": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "age": 10.170937976999999, 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.047241290999999998, 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type_data": { 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client_info": { 2024-04-26T12:12:09.419 INFO:teuthology.orchestra.run.smithi094.stdout: "client": "client.4719", 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "tid": 279514 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "events": [ 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "initiated", 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "throttled", 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139879+0000", 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0 2024-04-26T12:12:09.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "header_read", 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139878+0000", 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "all_read", 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.139883+0000", 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 4.3950000000000003e-06 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "dispatched", 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182261+0000", 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.042377807000000003 2024-04-26T12:12:09.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182281+0000", 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 1.9851e-05 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "reached_pg", 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182332+0000", 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 5.1597000000000001e-05 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "started", 2024-04-26T12:12:09.422 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182479+0000", 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00014700100000000001 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "waiting for subops from 2", 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.182613+0000", 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.00013436899999999999 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "op_commit", 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.184655+0000", 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0020416449999999999 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.423 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187055+0000", 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 0.0024002049999999999 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "commit_sent", 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187083+0000", 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 2.7702999999999999e-05 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "event": "done", 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "time": "2024-04-26T12:11:59.187120+0000", 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: "duration": 3.7449e-05 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.424 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-04-26T12:12:09.425 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-04-26T12:12:09.425 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-04-26T12:12:09.426 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:09.427 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:09.424+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:09.527 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:09.525+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:09.560 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:09.560 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:12:09.561 INFO:teuthology.orchestra.run.smithi104.stdout: "num_ops": 0 2024-04-26T12:12:09.561 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:09.570 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:09.616 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-26T12:12:09.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-26T12:12:09.655 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:09.653+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:09.730 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:09.729+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:09.738 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:09.738 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [], 2024-04-26T12:12:09.738 INFO:teuthology.orchestra.run.smithi104.stdout: "complaint_time": 30, 2024-04-26T12:12:09.738 INFO:teuthology.orchestra.run.smithi104.stdout: "num_blocked_ops": 0 2024-04-26T12:12:09.739 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:09.749 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:09.834 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:09.832+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:09.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:12:09.918 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 20, 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 600, 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "ops": [ 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:78039 5.5 5:a875e63e:::benchmark_data_smithi045_43640_object78038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 89.939672111999997, 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023080119999999999, 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.919 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 78039 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976778+0000", 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976811+0000", 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976818+0000", 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.1520000000000003e-06 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.976824+0000", 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7880000000000003e-06 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986354+0000", 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0095295880000000003 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986462+0000", 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000108713 2024-04-26T12:12:09.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 0", 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.986572+0000", 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00010969899999999999 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.991860+0000", 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0052879119999999996 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999725+0000", 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078656030000000005 2024-04-26T12:12:09.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999812+0000", 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6902000000000002e-05 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:39.999858+0000", 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.924 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:87776 5.c 5:38c57afc:::benchmark_data_smithi045_43640_object87775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 84.448483081000006, 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024835251999999999, 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 87776 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:09.925 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.467967+0000", 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.926 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468053+0000", 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.6458000000000005e-05 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468060+0000", 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.421e-06 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.468063+0000", 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8279999999999996e-06 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469899+0000", 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0018356379999999999 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.469993+0000", 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3424000000000005e-05 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492682+0000", 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022689872999999999 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492728+0000", 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5169000000000001e-05 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492803+0000", 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.4948000000000001e-05 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:87779 5.4 e31/17 5:2058a54b:::benchmark_data_smithi045_43640_object87778:head v 31'5545, mlcod=31'5542)", 2024-04-26T12:12:09.929 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 84.446131704999999, 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022515957, 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470319+0000", 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470318+0000", 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470349+0000", 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.0898999999999997e-05 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470355+0000", 2024-04-26T12:12:09.931 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.8900000000000004e-06 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.470359+0000", 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.211e-06 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473061+0000", 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027019230000000002 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.473080+0000", 2024-04-26T12:12:09.932 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.8185999999999998e-05 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492806+0000", 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019726183000000001 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:45.492835+0000", 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.8935e-05 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96923 5.e e33/17 5:79f49b2a:::benchmark_data_smithi045_43640_object96922:head v 33'6083, mlcod=33'6081)", 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.433033421999994, 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025745957999999999, 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.934 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483417+0000", 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483416+0000", 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483471+0000", 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.4623000000000002e-05 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.935 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483480+0000", 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.7970000000000006e-06 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483492+0000", 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2398000000000001e-05 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483529+0000", 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7183e-05 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.483550+0000", 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.0979999999999999e-05 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509135+0000", 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025585033 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509163+0000", 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7475999999999999e-05 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.937 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96936 5.e e33/17 5:7cc02dc6:::benchmark_data_smithi045_43640_object96935:head v 33'6084, mlcod=33'6081)", 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.429778444999997, 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022509830000000002, 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:09.938 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486672+0000", 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.939 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486740+0000", 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.8347000000000001e-05 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486752+0000", 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2102e-05 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486756+0000", 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7869999999999999e-06 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.940 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486813+0000", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.7015999999999998e-05 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.486830+0000", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.7544e-05 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509167+0000", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022336257000000002 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.509182+0000", 2024-04-26T12:12:09.941 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.5175e-05 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:96940 5.6 5:68152de6:::benchmark_data_smithi045_43640_object96939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.427280769999996, 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026251897, 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.942 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 96940 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489170+0000", 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.943 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489169+0000", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489217+0000", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7775000000000003e-05 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489227+0000", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0042e-05 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489234+0000", 2024-04-26T12:12:09.944 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492853+0000", 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00361897 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492979+0000", 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012595400000000001 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.945 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515303+0000", 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022323494999999999 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515348+0000", 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.5065000000000003e-05 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515422+0000", 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3627000000000005e-05 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.946 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96943 5.e e33/17 5:750cb6a3:::benchmark_data_smithi045_43640_object96942:head v 33'6085, mlcod=33'6081)", 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.426597469000001, 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.025599746999999999, 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.947 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489853+0000", 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489923+0000", 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0141000000000005e-05 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.948 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489930+0000", 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.3259999999999998e-06 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.489935+0000", 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490786+0000", 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00085090899999999995 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.949 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.490806+0000", 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9936999999999999e-05 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515425+0000", 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024619321999999999 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515453+0000", 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7429000000000001e-05 2024-04-26T12:12:09.950 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:96944 5.e e33/17 5:708f3e06:::benchmark_data_smithi045_43640_object96943:head v 33'6086, mlcod=33'6081)", 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 80.424476952999996, 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.023501542, 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.951 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.491973+0000", 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.952 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492034+0000", 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.1478999999999999e-05 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492044+0000", 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.0013999999999999e-05 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492052+0000", 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.953 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492867+0000", 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00081538599999999998 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.492887+0000", 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.9457e-05 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515455+0000", 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.02256826 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.954 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:10:49.515475+0000", 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.978e-05 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_repop(client.4719.0:144980 5.4 e40/17 5:2e3a0379:::benchmark_data_smithi045_43640_object144979:head v 40'9140, mlcod=40'9135)", 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 58.863813536000002, 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022477225, 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.955 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052637+0000", 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052636+0000", 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.956 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052729+0000", 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.2399999999999996e-05 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052738+0000", 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.3789999999999995e-06 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.052749+0000", 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.957 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067231+0000", 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.014481463 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.067250+0000", 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.908e-05 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075081+0000", 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0078309599999999997 2024-04-26T12:12:09.958 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:11.075114+0000", 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3268000000000001e-05 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:168889 5.2 5:49e7ecf7:::benchmark_data_smithi045_43640_object20515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 49.883545058999999, 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022972976999999999, 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.959 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 168889 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:09.962 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032905+0000", 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032907+0000", 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.599e-06 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.963 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032915+0000", 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.5610000000000001e-06 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.032921+0000", 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.789e-06 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044084+0000", 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011163373000000001 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.964 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.044223+0000", 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00013865700000000001 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055764+0000", 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011541282999999999 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055806+0000", 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.142e-05 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.965 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:20.055878+0000", 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2732999999999996e-05 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:193959 5.6 5:64a4b32f:::benchmark_data_smithi045_43640_object45585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 41.029047194, 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.024613037000000001, 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.966 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 193959 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887403+0000", 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887406+0000", 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887414+0000", 2024-04-26T12:12:09.968 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.887419+0000", 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.8579999999999999e-06 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895039+0000", 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0076196379999999998 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.895177+0000", 2024-04-26T12:12:09.969 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000138472 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911858+0000", 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.016680861000000002 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.911934+0000", 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6149999999999994e-05 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:28.912016+0000", 2024-04-26T12:12:09.970 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:217997 5.a 5:51103090:::benchmark_data_smithi045_43640_object69623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 32.641918232999998, 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.026309939000000001, 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.971 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 217997 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274532+0000", 2024-04-26T12:12:09.972 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274535+0000", 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274541+0000", 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3829999999999997e-06 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.274545+0000", 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7160000000000001e-06 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285851+0000", 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.011305525 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.285973+0000", 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000122378 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.974 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.286091+0000", 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000118423 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.291813+0000", 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0057214529999999996 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300766+0000", 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0089537079999999995 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.975 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300807+0000", 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0648000000000001e-05 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:37.300842+0000", 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4950000000000002e-05 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279510 5.a 5:53fa43a7:::benchmark_data_smithi045_43640_object131136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:09.976 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.780325672, 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.054251191999999997, 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279510 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.977 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136125+0000", 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136124+0000", 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136127+0000", 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.616e-06 2024-04-26T12:12:09.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136133+0000", 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3500000000000002e-06 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.136138+0000", 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.1719999999999998e-06 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138045+0000", 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001906951 2024-04-26T12:12:09.979 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138189+0000", 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00014377899999999999 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138303+0000", 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000113818 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140841+0000", 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0025384349999999999 2024-04-26T12:12:09.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190315+0000", 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049474016000000003 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190343+0000", 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7670000000000001e-05 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190376+0000", 2024-04-26T12:12:09.981 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.2861999999999998e-05 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279512 5.a 5:506620c5:::benchmark_data_smithi045_43640_object131138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.779177281000001, 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053205386, 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.982 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279512 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137273+0000", 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.983 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137272+0000", 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137277+0000", 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6430000000000003e-06 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137285+0000", 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.984 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.137291+0000", 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.84e-06 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139486+0000", 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0021944460000000001 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139576+0000", 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.0016e-05 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:09.985 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.139661+0000", 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.4876999999999994e-05 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140848+0000", 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0011877789999999999 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190405+0000", 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.049556986999999997 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.986 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190444+0000", 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8711999999999998e-05 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190478+0000", 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.4437999999999998e-05 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279513 5.a 5:56a75d68:::benchmark_data_smithi045_43640_object131139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:09.987 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.777680886000001, 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051809704999999998, 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279513 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.988 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138769+0000", 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138773+0000", 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.1150000000000004e-06 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.989 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138782+0000", 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.8659999999999995e-06 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.138788+0000", 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.6710000000000004e-06 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140872+0000", 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.002084757 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141001+0000", 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012882900000000001 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141128+0000", 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00012668799999999999 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145398+0000", 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0042697710000000003 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190512+0000", 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.045114639999999998 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190550+0000", 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7351999999999997e-05 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.190579+0000", 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.9611000000000002e-05 2024-04-26T12:12:09.992 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279516 5.a 5:56b1c475:::benchmark_data_smithi045_43640_object131142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.775457020999999, 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.052473375000000003, 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279516 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.993 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140993+0000", 2024-04-26T12:12:09.994 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.140997+0000", 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7439999999999998e-06 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141009+0000", 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.1697e-05 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.141015+0000", 2024-04-26T12:12:09.995 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3339999999999998e-06 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142442+0000", 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001426166 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142531+0000", 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.9800000000000001e-05 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:09.996 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142609+0000", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.7585999999999999e-05 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146926+0000", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0043168249999999998 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193382+0000", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046456467000000001 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193430+0000", 2024-04-26T12:12:09.997 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.7508e-05 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193467+0000", 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.7015999999999999e-05 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279518 5.a 5:57f8d5df:::benchmark_data_smithi045_43640_object131144:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.774099093, 2024-04-26T12:12:09.998 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051251170999999998, 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279518 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:09.999 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142351+0000", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142353+0000", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.2709999999999999e-06 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:10.000 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142362+0000", 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.1200000000000008e-06 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142366+0000", 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8130000000000002e-06 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143469+0000", 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001103 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:10.001 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143546+0000", 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6816000000000005e-05 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.143611+0000", 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5492000000000002e-05 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146930+0000", 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0033186999999999999 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.002 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193518+0000", 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046587564999999997 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193564+0000", 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.6090000000000001e-05 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193602+0000", 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.8800000000000001e-05 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:10.003 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279519 5.a 5:55c308c1:::benchmark_data_smithi045_43640_object131145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.773847946, 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.051119220999999999, 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279519 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.004 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142602+0000", 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.999999 2024-04-26T12:12:10.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142606+0000", 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2769999999999999e-06 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142616+0000", 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.7259999999999997e-06 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142623+0000", 2024-04-26T12:12:10.006 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144446+0000", 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.001823627 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144542+0000", 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 9.556e-05 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.144607+0000", 2024-04-26T12:12:10.007 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.5412000000000003e-05 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146934+0000", 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0023270040000000001 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193638+0000", 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.046703421000000002 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193681+0000", 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.3409999999999999e-05 2024-04-26T12:12:10.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.193722+0000", 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.0466999999999997e-05 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:279521 5.a 5:5bb84d9c:::benchmark_data_smithi045_43640_object131147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.773770363000001, 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.053246825999999997, 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:10.009 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 279521 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:10.010 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142680+0000", 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142679+0000", 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142683+0000", 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6229999999999999e-06 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:10.011 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142691+0000", 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.1270000000000003e-06 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.142697+0000", 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.3389999999999998e-06 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145438+0000", 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0027404679999999998 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:10.012 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145515+0000", 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.6913e-05 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "waiting for subops from 1", 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.145587+0000", 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.2484000000000006e-05 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.146938+0000", 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0013503390000000001 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.013 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195863+0000", 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.048925457999999998 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195890+0000", 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 2.7158999999999999e-05 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.195927+0000", 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.6569000000000002e-05 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.014 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4719.0:281444 5.6 5:6edbfc9d:::benchmark_data_smithi045_43640_object133070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 10.054087289, 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.022540986999999998, 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "type_data": { 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client_info": { 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client": "client.4719", 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "client_addr": "172.21.15.45:0/2513280543", 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "tid": 281444 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.015 INFO:teuthology.orchestra.run.smithi104.stdout: "events": [ 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "initiated", 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "throttled", 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862363+0000", 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4294967295.9999995 2024-04-26T12:12:10.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "all_read", 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862366+0000", 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "dispatched", 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862374+0000", 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 8.2430000000000005e-06 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "queued_for_pg", 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.862380+0000", 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 6.173e-06 2024-04-26T12:12:10.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.867290+0000", 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0049099920000000002 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "started", 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.871681+0000", 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.004390489 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "op_commit", 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884771+0000", 2024-04-26T12:12:10.018 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.013090421 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "commit_sent", 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884824+0000", 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.2766000000000003e-05 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "done", 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2024-04-26T12:11:59.884904+0000", 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 7.9946999999999999e-05 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-26T12:12:10.019 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-26T12:12:10.020 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-26T12:12:10.021 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:12:10.022 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-04-26T12:12:10.020+0000 7f9f9c49a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40363) UID: 0 2024-04-26T12:12:10.067 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1: {} 2024-04-26T12:12:10.089 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2: {} 2024-04-26T12:12:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:12:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:12:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:12:10.091 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:12:10.092 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:12:10.122 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:10.121+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:10.166 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:10.166 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:10.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:12:10.223 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-26T12:12:10.221+0000 7f9f92109700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40671) UID: 0 2024-04-26T12:12:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is set 2024-04-26T12:12:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'unique_pool_0' removed 2024-04-26T12:12:10.310 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:10.310 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:10.317 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T12:12:10.327 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T12:12:10.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-04-26T12:12:10.329 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:12:10.480 INFO:teuthology.orchestra.run.smithi094.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:10.480 INFO:teuthology.orchestra.run.smithi094.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:10.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:12:10.631 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:10.631 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:10.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:12:10.770 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:10.771 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:10.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:12:10.907 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument 2024-04-26T12:12:10.907 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:12:12.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:12:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:noscrub is unset 2024-04-26T12:12:13.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:12:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:nodeep-scrub is unset 2024-04-26T12:12:16.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-04-26T12:12:21.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-04-26T12:12:27.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-04-26T12:12:33.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-26T12:12:39.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-04-26T12:12:45.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-04-26T12:12:50.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~123s 2024-04-26T12:12:56.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-04-26T12:13:02.544 DEBUG:teuthology.orchestra.console.smithi071:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D7 65 GUID: 00000000 0000 0000 0000 0CC47AD8AA4A DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.71 MAS 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.71 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d7:65)... Configuring (net0 0c:c4:7a:8f:d7:65).... Configuring (net0 0c:c4:7a:8f:d7:65)..... Configuring (net0 0c:c4:7a:8f:d7:65)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6>              The selected entry will be started automatically in 5s.  Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6*           The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 4.18.0-513.9.1.el8_9.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)) #1 SMP Thu Nov 16 10:29:04 EST 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.723 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34850000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29128 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1755000K/33437920K available (14341K kernel code, 5952K rwdata, 8520K rodata, 2608K init, 26336K bss, 949692K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 40939 entries in 160 pages [ 0.000000] ftrace: allocated 160 pages with 2 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013032] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014474] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32724b4480e, max_idle_ns: 440795332432 ns [ 0.020000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.44 BogoMIPS (lpj=3499723) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022021] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030423] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033694] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034076] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035070] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036208] CPU0: Thermal monitoring enabled (TM1) [ 0.037056] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045005] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050490] Freeing SMP alternatives memory: 36K [ 0.051195] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.154247] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164031] rcu: Hierarchical SRCU implementation. [ 0.166059] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.167015] smp: Bringing up secondary CPUs ... [ 0.168072] x86: Booting SMP configuration: [ 0.169001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.172116] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.174000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.175001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.176093] #5 #6 #7 [ 0.177553] smp: Brought up 1 node, 8 CPUs [ 0.179000] smpboot: Max logical packages: 1 [ 0.180001] smpboot: Total of 8 processors activated (55995.56 BogoMIPS) [ 0.216233] node 0 deferred pages initialised in 34ms [ 0.222389] devtmpfs: initialized [ 0.223040] x86/mm: Memory block size: 128MB [ 0.225768] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.234085] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.244008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.251060] pinctrl core: initialized pinctrl subsystem [ 0.256121] NET: Registered protocol family 16 [ 0.261081] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.268012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.276008] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.284019] audit: initializing netlink subsys (disabled) [ 0.289010] audit: type=2000 audit(1714133553.289:1): state=initialized audit_enabled=0 res=1 [ 0.298002] cpuidle: using governor menu [ 0.302030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.309001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.316052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.325001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.332014] PCI: Using configuration type 1 for base access [ 0.339030] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.340001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.341023] cryptd: max_cpu_qlen set to 1000 [ 0.346051] ACPI: Added _OSI(Module Device) [ 0.350001] ACPI: Added _OSI(Processor Device) [ 0.354000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.359000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.364001] ACPI: Added _OSI(Linux-Dell-Video) [ 0.369000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.374000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.408683] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.417767] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.426073] ACPI: Dynamic OEM Table Load: [ 0.445284] ACPI: Interpreter enabled [ 0.449010] ACPI: PM: (supports S0 S4 S5) [ 0.453000] ACPI: Using IOAPIC for interrupt routing [ 0.458017] HEST: Enabling Firmware First mode for corrected errors. [ 0.465073] HEST: Table parsing has been initialized. [ 0.470001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.479583] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.510631] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.516003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.527438] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.535607] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.543000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.551029] PCI host bridge to bus 0000:ff [ 0.556001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.561010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.567043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.573033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.579026] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.585034] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.591031] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.597031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.603031] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.609033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.615035] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.621036] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.627032] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.633031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.639031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.645031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.651032] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.657032] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.663030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.669031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.675023] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.681037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.688062] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.694042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.700042] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.706042] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.712043] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.718041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.724039] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.730036] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.736041] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.742043] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.748043] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.754041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.760033] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.766033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.772032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.778035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.784038] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.790044] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.796033] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.802044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.808037] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.814034] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.820033] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.826031] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.832034] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.839034] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.845032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.851037] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.857032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.863031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.869033] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.875024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.881034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.887034] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.895897] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.902002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.911151] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.919282] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.927001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.935557] PCI host bridge to bus 0000:00 [ 0.940001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.947000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.954000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.961000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.968000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.976000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.983000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.989021] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.995098] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.001043] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.007095] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.013043] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.019086] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.025042] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.032081] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.038007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.044080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.051007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.057079] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.063007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.070080] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.076007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.083068] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.089008] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.096070] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.102008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.109081] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.115007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.122078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.128007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.135062] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.141064] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.147082] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.153058] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.159005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.165078] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.171063] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.177011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.183006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.188006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.194006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.200007] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.205006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.211029] pci 0000:00:11.4: PME# supported from D3hot [ 1.217080] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.223014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.230051] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.235090] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.242014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.248051] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.254059] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.261013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.267050] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.273070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.280014] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.286043] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.292076] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.298066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.304077] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.310067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.316076] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.323068] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.329079] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.335013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.341072] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.347076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.353158] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.359009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.365005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.371005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.376005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.382005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.387005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.394030] pci 0000:00:1f.2: PME# supported from D3hot [ 1.399062] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.405014] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.412016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.417169] acpiphp: Slot [1] registered [ 1.421014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.426123] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.432008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.439016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.446003] pci 0000:02:00.0: enabling Extended Tags [ 1.451086] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.456002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.463126] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.469010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.476004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.482009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.489004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.496035] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.502015] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.509001] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.519008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.527000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.537149] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.543009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.550004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.556009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.563004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.570033] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.576014] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.583000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.593008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.601001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.611080] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.616002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.622001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.629002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.637028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.642062] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.648065] pci 0000:05:00.0: enabling Extended Tags [ 1.653070] pci 0000:05:00.0: supports D1 D2 [ 1.657000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.664090] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.669002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.675002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.682047] pci_bus 0000:06: extended config space not accessible [ 1.688027] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.694022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.700013] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.707012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.712051] pci 0000:06:00.0: supports D1 D2 [ 1.716001] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.723109] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.728006] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.734003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.741084] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.747017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.753018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.759009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.765076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.771035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.779000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.789021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.796000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.806169] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.813017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.819018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.824009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.831086] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.837032] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.844001] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.854021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.862000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.872159] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.877002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.883002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.890003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.897403] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.903036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.909047] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.915035] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.921034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.927000] ACPI: PCI: Interrupt link LNKE disabled [ 1.932034] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.938000] ACPI: PCI: Interrupt link LNKF disabled [ 1.943034] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.949000] ACPI: PCI: Interrupt link LNKG disabled [ 1.954046] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.960001] ACPI: PCI: Interrupt link LNKH disabled [ 1.965206] iommu: Default domain type: Passthrough [ 1.970064] SCSI subsystem initialized [ 1.974016] ACPI: bus type USB registered [ 1.978012] usbcore: registered new interface driver usbfs [ 1.983005] usbcore: registered new interface driver hub [ 1.988007] usbcore: registered new device driver usb [ 1.993018] pps_core: LinuxPPS API ver. 1 registered [ 1.998000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.008001] PTP clock support registered [ 2.012008] EDAC MC: Ver: 3.0.0 [ 2.015110] PCI: Using ACPI for IRQ routing [ 2.024637] NetLabel: Initializing [ 2.028000] NetLabel: domain hash size = 128 [ 2.032000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.038011] NetLabel: unlabeled traffic allowed by default [ 2.043022] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.044000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.058002] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.064000] vgaarb: loaded [ 2.066043] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.073000] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.080021] clocksource: Switched to clocksource tsc-early [ 2.095526] VFS: Disk quotas dquot_6.6.0 [ 2.099458] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.106382] pnp: PnP ACPI init [ 2.109794] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.115710] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.121620] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.127532] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.133442] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.139354] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.145265] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.151869] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.158475] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.165079] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.171683] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.178287] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.184891] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.191671] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.197583] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.203493] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.209406] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.215316] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.221969] pnp: PnP ACPI: found 5 devices [ 2.231464] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.240373] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.251849] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.259668] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.264629] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.269592] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.276373] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.283936] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.291842] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.299486] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.307478] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.315034] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.322940] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.330584] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.338576] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.346134] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.354040] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.361684] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.369676] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.377232] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.385138] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.392783] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.400773] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.405731] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.411818] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.418595] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.426329] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.431298] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.436261] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.442347] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.449139] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.454357] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.460443] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.467226] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.474963] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.482789] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.490528] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.498348] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.503310] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.509398] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.516184] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.523916] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.532955] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.539124] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.545295] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.552159] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.559025] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.565889] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.572755] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.579013] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.584577] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.590835] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.598047] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.603611] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.609869] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.615433] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.621692] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.627255] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.633514] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.640840] NET: Registered protocol family 2 [ 2.645392] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.654661] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.663523] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.671930] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.679506] TCP: Hash tables configured (established 262144 bind 65536) [ 2.686222] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.693972] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.700999] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.708476] NET: Registered protocol family 1 [ 2.712835] NET: Registered protocol family 44 [ 2.717359] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.740136] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 15189 usecs [ 2.763133] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 15221 usecs [ 2.770541] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.776992] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.785369] Unpacking initramfs... [ 3.075811] Freeing initrd memory: 28480K [ 3.079898] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.086332] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.094245] ACPI: bus type thunderbolt registered [ 3.100573] Initialise system trusted keyrings [ 3.105023] Key type blacklist registered [ 3.109061] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.116958] zbud: loaded [ 3.119780] pstore: using deflate compression [ 3.124314] Platform Keyring initialized [ 3.166658] NET: Registered protocol family 38 [ 3.171101] Key type asymmetric registered [ 3.175190] Asymmetric key parser 'x509' registered [ 3.180062] Running certificate verification selftests [ 3.210648] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.221534] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.228953] io scheduler mq-deadline registered [ 3.233482] io scheduler kyber registered [ 3.237509] io scheduler bfq registered [ 3.241403] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.248627] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.254541] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.260432] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.266303] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.272176] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.278051] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.283930] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.291220] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.299580] ACPI: Power Button [PWRB] [ 3.303267] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.310679] ACPI: Power Button [PWRF] [ 3.315830] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.323329] pstore: Registered erst as persistent store backend [ 3.329392] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.336885] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.363737] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.391668] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.399394] Non-volatile memory driver v1.3 [ 3.403953] rdac: device handler registered [ 3.408183] hp_sw: device handler registered [ 3.412448] emc: device handler registered [ 3.416603] alua: device handler registered [ 3.420851] libphy: Fixed MDIO Bus: probed [ 3.425193] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.430453] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.437855] ehci-pci 0000:00:1d.0: debug port 2 [ 3.446291] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.458038] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.463805] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.472063] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.479274] usb usb1: Product: EHCI Host Controller [ 3.484143] usb usb1: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.491356] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.496076] hub 1-0:1.0: USB hub found [ 3.499868] hub 1-0:1.0: 2 ports detected [ 3.504003] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.509286] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.517724] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.526996] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.527021] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.532270] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.537492] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.544819] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.552219] ehci-pci 0000:00:1a.0: debug port 2 [ 3.558482] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.566907] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.571238] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.583034] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.584099] usb usb2: Product: xHCI Host Controller [ 3.594706] usb usb2: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.601920] usb usb2: SerialNumber: 0000:00:14.0 [ 3.606654] hub 2-0:1.0: USB hub found [ 3.610452] hub 2-0:1.0: 15 ports detected [ 3.617248] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.625505] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.632714] usb usb3: Product: xHCI Host Controller [ 3.637585] usb usb3: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.644797] usb usb3: SerialNumber: 0000:00:14.0 [ 3.649579] hub 3-0:1.0: USB hub found [ 3.653378] hub 3-0:1.0: 6 ports detected [ 3.658877] usbcore: registered new interface driver usbserial_generic [ 3.658888] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.665406] usbserial: USB Serial support registered for generic [ 3.673659] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.679685] i8042: PNP: No PS/2 controller found. [ 3.686870] usb usb4: Product: EHCI Host Controller [ 3.691621] mousedev: PS/2 mouse device common for all mice [ 3.696439] usb usb4: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.696440] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.702326] rtc_cmos 00:00: RTC can wake from S4 [ 3.709295] hub 4-0:1.0: USB hub found [ 3.714052] rtc_cmos 00:00: registered as rtc0 [ 3.718456] hub 4-0:1.0: 2 ports detected [ 3.722210] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.738424] intel_pstate: Intel P-state driver initializing [ 3.745098] hid: raw HID events driver (C) Jiri Kosina [ 3.750257] usbcore: registered new interface driver usbhid [ 3.754039] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.755820] usbhid: USB HID core driver [ 3.766252] drop_monitor: Initializing network drop monitor service [ 3.772557] Initializing XFRM netlink socket [ 3.776897] NET: Registered protocol family 10 [ 3.781559] Segment Routing with IPv6 [ 3.785232] NET: Registered protocol family 17 [ 3.789748] mpls_gso: MPLS GSO support [ 3.793923] microcode: Microcode Update Driver: v2.2. [ 3.793975] resctrl: L3 allocation detected [ 3.803196] resctrl: L3 monitoring detected [ 3.807383] AVX2 version of gcm_enc/dec engaged. [ 3.811994] AES CTR mode by8 optimization enabled [ 3.826860] sched_clock: Marking stable (3826854495, 0)->(5643019783, -1816165288) [ 3.834537] registered taskstats version 1 [ 3.838772] Loading compiled-in X.509 certificates [ 3.843836] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 3b1bc9a9bf3bdfe93ac380c73845d894639c5bcf' [ 3.854692] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.866034] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.866522] Loaded X.509 cert 'Red Hat Enterprise Linx kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.883473] zswap: loaded using pool lzo/zbud [ 3.887941] page_owner is disabled [ 3.890393] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.894709] Key type big_key registered [ 3.899527] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.899798] hub 1-1:1.0: USB hub found [ 3.905013] Key type encrypted registered [ 3.910645] hub 1-1:1.0: 8 ports detected [ 3.914309] ima: No TPM chip found, activating TPM-bypass! [ 3.927797] ima: Allocated hash algorithm: sha256 [ 3.932504] ima: No architecture policies found [ 3.937040] evm: Initialising EVM extended attributes: [ 3.942170] evm: security.selinux [ 3.945482] evm: security.ima [ 3.948446] evm: security.capability [ 3.952029] evm: HMAC attrs: 0x1 [ 3.955512] rtc_cmos 00:00: setting system clock to 2024-04-26 12:12:39 UTC (1714133559) [ 3.964857] Freeing unused decrypted memory: 2036K [ 3.969991] Freeing unused kernel image (initmem) memory: 2608K [ 3.970008] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.992065] Write protecting the kernel read-only data: 26624k [ 3.998190] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.998267] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.006442] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.020549] Freeing unused kernel image (rodata/data gap) memory: 1720K [ 4.020808] hub 2-12:1.0: USB hub found [ 4.031071] hub 2-12:1.0: 4 ports detected [ 4.041511] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.075135] systemd[1]: Detected architecture x86-64. [ 4.080189] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.110097] systemd[1]: Set hostname to . [ 4.115284] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.123454] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.128044] tsc: Refined TSC clocksource calibration: 3499.995 MHz [ 4.130705] hub 4-1:1.0: USB hub found [ 4.136818] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734c8180a, max_idle_ns: 440795326857 ns [ 4.150570] clocksource: Switched to clocksource tsc [ 4.156662] hub 4-1:1.0: 6 ports detected [ 4.189948] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.203147] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.215086] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.225093] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.235292] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.247108] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ocket. Starting Setup Virtual Console... Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. [ 4.348036] uspeed USB device0;32m OK ]a…vice nodes for the current kernel. [ OK ] Started Journal Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started drac[ 4.452388] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.460831] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Starting udev Kernel Device Manager... [ 4.473209] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.536172] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.548754] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.560509] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ 4.631695] dca service started, version 1.12.1 [ 4.644658] nvme nvme0: pci function 0000:02:00.0 [ OK ] Reached target System Initialization. Starting dracut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymo[ 4.667934] igb: Intel(R) Gigabit Ethernet Network Driver uth Directory Wa[ 4.669297] nvme nvme0: 8/0/0 default/read/poll queues tch. [ [ 4.674189] igb: Copyright (c) 2007-2014 Intel Corporation. OK ] Reach[ 4.688103] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver ed target Paths.[ 4.688490] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.688953] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ OK [ 4.688957] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ] Reached t[ 4.695148] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.699654] scsi host0: ahci arget Basic Syst[ 4.730222] scsi host1: ahci [ 4.730245] ACPI: bus type drm_connector registered em. [ 4.734320] scsi host2: ahci [ 4.742636] scsi host3: ahci [ 4.742691] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 4.752936] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 4.752939] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 4.752942] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.753328] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.757645] igb 0000:07:00.0: added PHC on eth0 [ 4.757647] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.757649] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:aa:4a [ 4.757724] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.757726] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.813434] igb 0000:07:00.1: added PHC on eth1 [ 4.814581] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.819106] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.833530] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:aa:4b [ 4.833639] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.833641] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.834882] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.842367] scsi host4: ahci [ 4.864533] scsi host5: ahci [ 4.864662] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.867536] scsi host6: ahci [ 4.873933] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.876957] scsi host7: ahci [ 4.881868] ast 0000:06:00.0: [drm] Using analog VGA [ 4.884877] scsi host8: ahci [ 4.889705] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.892726] scsi host9: ahci [ 4.899542] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.902196] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.902319] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.921655] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.921657] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.921659] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.921661] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.921662] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.958820] fbcon: astdrmfb (fb0) is primary device [ 5.008134] Console: switching to colour frame buffer device 128x48 [ 5.055370] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.062259] ata1: SATA link down (SStatus 0 SControl 300) [ 5.067716] ata2: SATA link down (SStatus 0 SControl 300) [ 5.067745] ata3: SATA link down (SStatus 0 SControl 300) [ 5.078553] ata4: SATA link down (SStatus 0 SControl 300) [ 5.229919] ata10: SATA link down (SStatus 0 SControl 300) [ 5.235424] ata6: SATA link down (SStatus 0 SControl 300) [ 5.240830] ata8: SATA link down (SStatus 0 SControl 300) [ 5.246238] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.252442] ata7: SATA link down (SStatus 0 SControl 300) [ 5.257866] ata9: SATA link down (SStatus 0 SControl 300) [ 5.264019] ata5.00: NCQ Send/Recv Log not supported [ 5.268985] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.275249] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.283733] ata5.00: NCQ Send/Recv Log not supported [ 5.288695] ata5.00: configured for UDMA/133 [ 5.293098] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.305593] scsi 4:0:scsi generic sg0[ 5.314695] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.322356] sd 4:0:0:0: [sda] Write Protect is off [ 5.327147] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.347945] sda: sda1 [ 5.350551] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.837292] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.847565] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.856070] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.862248] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d7:64 [ 5.869967] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.876589] libphy: ixgbe-mdio: probed [ 6.036130] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.046407] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.054911] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.061947] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d7:65 [ 6.069643] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.076222] libphy: ixgbe-mdio: probed [ 6.080930] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.095222] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. Starting File System Check on /dev/…588-86c5-4fa7-ad82-5a8bfe76a5e8... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started File System Check on /dev/d…0b588-86c5-4fa7-ad82-5a8bfe76a5e8. Mounting /sysroot... [ 6.297125] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped target Local File Systems. Starting Setup Virtual Console... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.641560] printk: systemd: 11 output lines suppressed due to ratelimiting [ 7.228543] SELinux: policy capability network_peer_controls=1 [ 7.234462] SELinux: policy capability open_perms=1 [ 7.239422] SELinux: policy capability extended_socket_class=1 [ 7.245334] SELinux: policy capability always_check_network=0 [ 7.251156] SELinux: policy capability cgroup_seclabel=1 [ 7.256548] SELinux: policy capability nnp_nosuid_transition=1 [ 7.284127] audit: type=1403 audit(1714133562.828:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.285949] systemd[1]: Successfully loaded SELinux policy in 227.650ms. [ 7.360563] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.455ms. [ 7.378016] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.412131] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.[ 7.430008] systemd[1]: Set hostname to . 6 (Ootpa)! [ 8.452811] systemd[1]: systemd-journald.service: Succeeded. [ 8.459211] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.465412] systemd[1]: Stopped Switch Root. [ OK [[ 8.470244] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.481757] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.492417] systemd[1]: Stopped Journal Service. [ OK [[ 8.498332] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Created slice User and Session Slice. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-getty.slice. Mounting POSIX Message Queue File System... [ 8.578579] EXT4-fs (sda1): re-mounted. Opts: (null) Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on udev Control Socket. [ OK ] Reached target RPC Port Mapper. Starting Load Kernel Modules... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target Slices. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. Mounting Huge Pages File System... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... Mounting Kernel Debug File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Reached target Swap. [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Started Journal Service. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journ[ 8.809581] device-mapper: uevent: version 1.0.3 al to Persistent[ 8.815809] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Storage. [ OK ] Started udev Coldplug all Devices. [ 8.839450] fuse: init (API version 7.34) [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Restore /run/initramfs on shutdown... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC Bind... Starting Security Auditing Service... [ 9.346561] RPC: Registered named UNIX socket transport module. [ 9.352478] RPC: Registered udp transport module. [ 9.357182] RPC: Registered tcp transport module. [ 9.361879] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 9.508557] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.525553] igb 0000:07:00.0: DCA enabled [ 9.529895] IPMI message handler: version 39.2 [ 9.529900] igb 0000:07:00.1: DCA enabled [ 9.540057] ipmi device interface [ 9.549158] ipmi_si: IPMI System Interface driver [ 9.554842] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.561226] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.568644] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.574595] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.580675] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.592203] power_meter ACPI000D:00: Found ACPI power meter. [ 9.597967] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.609574] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.618273] ipmi_si: Adding ACPI-specified kcs state machine [ 9.624010] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.624169] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 9.670419] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.705605] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.712234] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.742566] iTCO_vendor_support: vendor-support=0 [ 9.752474] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.813040] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.820977] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.826645] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.832853] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.838524] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.846019] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Started Security Auditing Service. Starting Updat[ 9.859132] ipmi_si IPI0001:00: IPMI kcs interface initialized e UTMP about System Boot/Shutdown... [ 9.870586] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Kernel Samepage Merging... Starting Resets System Activity Logs... Starting Authorization Manager... [ OK ] Started Machine Check Exception Logging Daemon. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service[ 10.029054] SGI XFS with ACLs, security attributes, quota, no debug enabled instances at once. [ [ 10.038436] XFS (dm-4): Mounting V5 Filesystem OK ] Started libstoragemgmt plug-in server daemon. [[0;3[ 10.048618] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.049053] XFS (dm-4): Ending clean mount 2m OK ] Re[ 10.060692] EDAC sbridge: Ver: 1.1.2 ached target sshd-keygen.target. Starting System Security Services Daemon... [ OK ] Started irqbalance daemon. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Reached target Timers. Starting VDO volume services... Starting NTP client/server... Starting Avahi mDNS/DNS-SD Stack... [ OK ] Started LVM event activation on device 259:0. [ 10.188330] intel_rapl_common: Found RAPL domain package [ 10.193652] intel_rapl_common: Found RAPL domain dram [ 10.198702] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Mounted /var/lib/ceph. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Resets System Activity Logs. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Enable periodic update of entitlement certificates.... Starting Network Manager Wait Online... [ OK ] Started NTP client/server. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Authorization Manager. [ 12.391835] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.448882] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.456515] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.512962] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.529308] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.571858] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.680911] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.689151] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.731715] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.841001] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.965078] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started VDO volume services. [ 13.160092] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.167954] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting CUPS Scheduler... Starting Login Service... Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (10s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. [ OK ] Started Nagios Remote Plugin Executor. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... Starting /etc/rc.d/rc.local Compatibility... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started System Logging Service. + myips=172.21.15.71 + attempts=1 + sleep 1 + '[' 172.21.15.71 '!=' '' ']' + set -e + '[' -n 172.21.15.71 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.71 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.71 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi071.front.sepia.ceph.com + '[' -n smithi071.front.sepia.ceph.com ']' + hostname smithi071.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi071 + echo smithi071 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.71 smithi071.front.sepia.ceph.com smithi071\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:13:02.545 DEBUG:teuthology.orchestra.console.smithi071:expect after: smithi071 login: 2024-04-26T12:13:02.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-04-26T12:13:02.598 DEBUG:teuthology.orchestra.console.smithi071:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D7 65 GUID: 00000000 0000 0000 0000 0CC47AD8AA4A DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.71 MAS 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.71 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d7:65)... Configuring (net0 0c:c4:7a:8f:d7:65).... Configuring (net0 0c:c4:7a:8f:d7:65)..... Configuring (net0 0c:c4:7a:8f:d7:65)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6>              The selected entry will be started automatically in 5s.  Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6*           The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 4.18.0-513.9.1.el8_9.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)) #1 SMP Thu Nov 16 10:29:04 EST 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.723 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34850000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29128 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1755000K/33437920K available (14341K kernel code, 5952K rwdata, 8520K rodata, 2608K init, 26336K bss, 949692K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 40939 entries in 160 pages [ 0.000000] ftrace: allocated 160 pages with 2 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013032] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014474] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32724b4480e, max_idle_ns: 440795332432 ns [ 0.020000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.44 BogoMIPS (lpj=3499723) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022021] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030423] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033694] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034076] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035070] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036208] CPU0: Thermal monitoring enabled (TM1) [ 0.037056] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045005] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050490] Freeing SMP alternatives memory: 36K [ 0.051195] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.154247] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164031] rcu: Hierarchical SRCU implementation. [ 0.166059] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.167015] smp: Bringing up secondary CPUs ... [ 0.168072] x86: Booting SMP configuration: [ 0.169001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.172116] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.174000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.175001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.176093] #5 #6 #7 [ 0.177553] smp: Brought up 1 node, 8 CPUs [ 0.179000] smpboot: Max logical packages: 1 [ 0.180001] smpboot: Total of 8 processors activated (55995.56 BogoMIPS) [ 0.216233] node 0 deferred pages initialised in 34ms [ 0.222389] devtmpfs: initialized [ 0.223040] x86/mm: Memory block size: 128MB [ 0.225768] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.234085] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.244008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.251060] pinctrl core: initialized pinctrl subsystem [ 0.256121] NET: Registered protocol family 16 [ 0.261081] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.268012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.276008] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.284019] audit: initializing netlink subsys (disabled) [ 0.289010] audit: type=2000 audit(1714133553.289:1): state=initialized audit_enabled=0 res=1 [ 0.298002] cpuidle: using governor menu [ 0.302030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.309001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.316052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.325001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.332014] PCI: Using configuration type 1 for base access [ 0.339030] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.340001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.341023] cryptd: max_cpu_qlen set to 1000 [ 0.346051] ACPI: Added _OSI(Module Device) [ 0.350001] ACPI: Added _OSI(Processor Device) [ 0.354000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.359000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.364001] ACPI: Added _OSI(Linux-Dell-Video) [ 0.369000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.374000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.408683] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.417767] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.426073] ACPI: Dynamic OEM Table Load: [ 0.445284] ACPI: Interpreter enabled [ 0.449010] ACPI: PM: (supports S0 S4 S5) [ 0.453000] ACPI: Using IOAPIC for interrupt routing [ 0.458017] HEST: Enabling Firmware First mode for corrected errors. [ 0.465073] HEST: Table parsing has been initialized. [ 0.470001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.479583] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.510631] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.516003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.527438] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.535607] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.543000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.551029] PCI host bridge to bus 0000:ff [ 0.556001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.561010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.567043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.573033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.579026] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.585034] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.591031] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.597031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.603031] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.609033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.615035] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.621036] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.627032] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.633031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.639031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.645031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.651032] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.657032] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.663030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.669031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.675023] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.681037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.688062] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.694042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.700042] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.706042] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.712043] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.718041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.724039] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.730036] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.736041] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.742043] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.748043] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.754041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.760033] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.766033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.772032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.778035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.784038] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.790044] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.796033] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.802044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.808037] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.814034] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.820033] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.826031] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.832034] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.839034] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.845032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.851037] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.857032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.863031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.869033] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.875024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.881034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.887034] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.895897] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.902002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.911151] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.919282] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.927001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.935557] PCI host bridge to bus 0000:00 [ 0.940001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.947000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.954000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.961000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.968000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.976000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.983000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.989021] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.995098] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.001043] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.007095] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.013043] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.019086] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.025042] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.032081] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.038007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.044080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.051007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.057079] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.063007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.070080] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.076007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.083068] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.089008] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.096070] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.102008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.109081] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.115007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.122078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.128007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.135062] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.141064] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.147082] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.153058] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.159005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.165078] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.171063] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.177011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.183006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.188006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.194006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.200007] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.205006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.211029] pci 0000:00:11.4: PME# supported from D3hot [ 1.217080] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.223014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.230051] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.235090] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.242014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.248051] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.254059] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.261013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.267050] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.273070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.280014] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.286043] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.292076] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.298066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.304077] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.310067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.316076] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.323068] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.329079] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.335013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.341072] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.347076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.353158] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.359009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.365005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.371005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.376005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.382005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.387005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.394030] pci 0000:00:1f.2: PME# supported from D3hot [ 1.399062] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.405014] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.412016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.417169] acpiphp: Slot [1] registered [ 1.421014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.426123] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.432008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.439016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.446003] pci 0000:02:00.0: enabling Extended Tags [ 1.451086] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.456002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.463126] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.469010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.476004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.482009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.489004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.496035] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.502015] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.509001] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.519008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.527000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.537149] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.543009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.550004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.556009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.563004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.570033] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.576014] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.583000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.593008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.601001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.611080] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.616002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.622001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.629002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.637028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.642062] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.648065] pci 0000:05:00.0: enabling Extended Tags [ 1.653070] pci 0000:05:00.0: supports D1 D2 [ 1.657000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.664090] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.669002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.675002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.682047] pci_bus 0000:06: extended config space not accessible [ 1.688027] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.694022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.700013] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.707012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.712051] pci 0000:06:00.0: supports D1 D2 [ 1.716001] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.723109] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.728006] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.734003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.741084] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.747017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.753018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.759009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.765076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.771035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.779000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.789021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.796000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.806169] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.813017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.819018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.824009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.831086] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.837032] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.844001] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.854021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.862000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.872159] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.877002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.883002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.890003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.897403] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.903036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.909047] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.915035] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.921034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.927000] ACPI: PCI: Interrupt link LNKE disabled [ 1.932034] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.938000] ACPI: PCI: Interrupt link LNKF disabled [ 1.943034] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.949000] ACPI: PCI: Interrupt link LNKG disabled [ 1.954046] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.960001] ACPI: PCI: Interrupt link LNKH disabled [ 1.965206] iommu: Default domain type: Passthrough [ 1.970064] SCSI subsystem initialized [ 1.974016] ACPI: bus type USB registered [ 1.978012] usbcore: registered new interface driver usbfs [ 1.983005] usbcore: registered new interface driver hub [ 1.988007] usbcore: registered new device driver usb [ 1.993018] pps_core: LinuxPPS API ver. 1 registered [ 1.998000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.008001] PTP clock support registered [ 2.012008] EDAC MC: Ver: 3.0.0 [ 2.015110] PCI: Using ACPI for IRQ routing [ 2.024637] NetLabel: Initializing [ 2.028000] NetLabel: domain hash size = 128 [ 2.032000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.038011] NetLabel: unlabeled traffic allowed by default [ 2.043022] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.044000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.058002] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.064000] vgaarb: loaded [ 2.066043] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.073000] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.080021] clocksource: Switched to clocksource tsc-early [ 2.095526] VFS: Disk quotas dquot_6.6.0 [ 2.099458] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.106382] pnp: PnP ACPI init [ 2.109794] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.115710] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.121620] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.127532] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.133442] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.139354] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.145265] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.151869] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.158475] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.165079] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.171683] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.178287] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.184891] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.191671] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.197583] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.203493] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.209406] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.215316] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.221969] pnp: PnP ACPI: found 5 devices [ 2.231464] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.240373] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.251849] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.259668] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.264629] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.269592] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.276373] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.283936] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.291842] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.299486] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.307478] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.315034] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.322940] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.330584] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.338576] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.346134] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.354040] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.361684] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.369676] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.377232] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.385138] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.392783] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.400773] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.405731] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.411818] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.418595] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.426329] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.431298] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.436261] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.442347] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.449139] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.454357] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.460443] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.467226] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.474963] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.482789] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.490528] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.498348] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.503310] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.509398] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.516184] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.523916] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.532955] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.539124] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.545295] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.552159] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.559025] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.565889] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.572755] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.579013] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.584577] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.590835] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.598047] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.603611] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.609869] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.615433] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.621692] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.627255] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.633514] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.640840] NET: Registered protocol family 2 [ 2.645392] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.654661] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.663523] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.671930] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.679506] TCP: Hash tables configured (established 262144 bind 65536) [ 2.686222] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.693972] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.700999] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.708476] NET: Registered protocol family 1 [ 2.712835] NET: Registered protocol family 44 [ 2.717359] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.740136] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 15189 usecs [ 2.763133] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 15221 usecs [ 2.770541] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.776992] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.785369] Unpacking initramfs... [ 3.075811] Freeing initrd memory: 28480K [ 3.079898] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.086332] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.094245] ACPI: bus type thunderbolt registered [ 3.100573] Initialise system trusted keyrings [ 3.105023] Key type blacklist registered [ 3.109061] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.116958] zbud: loaded [ 3.119780] pstore: using deflate compression [ 3.124314] Platform Keyring initialized [ 3.166658] NET: Registered protocol family 38 [ 3.171101] Key type asymmetric registered [ 3.175190] Asymmetric key parser 'x509' registered [ 3.180062] Running certificate verification selftests [ 3.210648] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.221534] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.228953] io scheduler mq-deadline registered [ 3.233482] io scheduler kyber registered [ 3.237509] io scheduler bfq registered [ 3.241403] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.248627] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.254541] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.260432] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.266303] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.272176] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.278051] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.283930] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.291220] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.299580] ACPI: Power Button [PWRB] [ 3.303267] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.310679] ACPI: Power Button [PWRF] [ 3.315830] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.323329] pstore: Registered erst as persistent store backend [ 3.329392] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.336885] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.363737] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.391668] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.399394] Non-volatile memory driver v1.3 [ 3.403953] rdac: device handler registered [ 3.408183] hp_sw: device handler registered [ 3.412448] emc: device handler registered [ 3.416603] alua: device handler registered [ 3.420851] libphy: Fixed MDIO Bus: probed [ 3.425193] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.430453] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.437855] ehci-pci 0000:00:1d.0: debug port 2 [ 3.446291] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.458038] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.463805] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.472063] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.479274] usb usb1: Product: EHCI Host Controller [ 3.484143] usb usb1: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.491356] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.496076] hub 1-0:1.0: USB hub found [ 3.499868] hub 1-0:1.0: 2 ports detected [ 3.504003] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.509286] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.517724] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.526996] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.527021] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.532270] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.537492] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.544819] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.552219] ehci-pci 0000:00:1a.0: debug port 2 [ 3.558482] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.566907] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.571238] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.583034] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.584099] usb usb2: Product: xHCI Host Controller [ 3.594706] usb usb2: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.601920] usb usb2: SerialNumber: 0000:00:14.0 [ 3.606654] hub 2-0:1.0: USB hub found [ 3.610452] hub 2-0:1.0: 15 ports detected [ 3.617248] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.625505] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.632714] usb usb3: Product: xHCI Host Controller [ 3.637585] usb usb3: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.644797] usb usb3: SerialNumber: 0000:00:14.0 [ 3.649579] hub 3-0:1.0: USB hub found [ 3.653378] hub 3-0:1.0: 6 ports detected [ 3.658877] usbcore: registered new interface driver usbserial_generic [ 3.658888] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.665406] usbserial: USB Serial support registered for generic [ 3.673659] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.679685] i8042: PNP: No PS/2 controller found. [ 3.686870] usb usb4: Product: EHCI Host Controller [ 3.691621] mousedev: PS/2 mouse device common for all mice [ 3.696439] usb usb4: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.696440] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.702326] rtc_cmos 00:00: RTC can wake from S4 [ 3.709295] hub 4-0:1.0: USB hub found [ 3.714052] rtc_cmos 00:00: registered as rtc0 [ 3.718456] hub 4-0:1.0: 2 ports detected [ 3.722210] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.738424] intel_pstate: Intel P-state driver initializing [ 3.745098] hid: raw HID events driver (C) Jiri Kosina [ 3.750257] usbcore: registered new interface driver usbhid [ 3.754039] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.755820] usbhid: USB HID core driver [ 3.766252] drop_monitor: Initializing network drop monitor service [ 3.772557] Initializing XFRM netlink socket [ 3.776897] NET: Registered protocol family 10 [ 3.781559] Segment Routing with IPv6 [ 3.785232] NET: Registered protocol family 17 [ 3.789748] mpls_gso: MPLS GSO support [ 3.793923] microcode: Microcode Update Driver: v2.2. [ 3.793975] resctrl: L3 allocation detected [ 3.803196] resctrl: L3 monitoring detected [ 3.807383] AVX2 version of gcm_enc/dec engaged. [ 3.811994] AES CTR mode by8 optimization enabled [ 3.826860] sched_clock: Marking stable (3826854495, 0)->(5643019783, -1816165288) [ 3.834537] registered taskstats version 1 [ 3.838772] Loading compiled-in X.509 certificates [ 3.843836] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 3b1bc9a9bf3bdfe93ac380c73845d894639c5bcf' [ 3.854692] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.866034] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.866522] Loaded X.509 cert 'Red Hat Enterprise Linx kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.883473] zswap: loaded using pool lzo/zbud [ 3.887941] page_owner is disabled [ 3.890393] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.894709] Key type big_key registered [ 3.899527] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.899798] hub 1-1:1.0: USB hub found [ 3.905013] Key type encrypted registered [ 3.910645] hub 1-1:1.0: 8 ports detected [ 3.914309] ima: No TPM chip found, activating TPM-bypass! [ 3.927797] ima: Allocated hash algorithm: sha256 [ 3.932504] ima: No architecture policies found [ 3.937040] evm: Initialising EVM extended attributes: [ 3.942170] evm: security.selinux [ 3.945482] evm: security.ima [ 3.948446] evm: security.capability [ 3.952029] evm: HMAC attrs: 0x1 [ 3.955512] rtc_cmos 00:00: setting system clock to 2024-04-26 12:12:39 UTC (1714133559) [ 3.964857] Freeing unused decrypted memory: 2036K [ 3.969991] Freeing unused kernel image (initmem) memory: 2608K [ 3.970008] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.992065] Write protecting the kernel read-only data: 26624k [ 3.998190] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.998267] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.006442] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.020549] Freeing unused kernel image (rodata/data gap) memory: 1720K [ 4.020808] hub 2-12:1.0: USB hub found [ 4.031071] hub 2-12:1.0: 4 ports detected [ 4.041511] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.075135] systemd[1]: Detected architecture x86-64. [ 4.080189] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.110097] systemd[1]: Set hostname to . [ 4.115284] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.123454] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.128044] tsc: Refined TSC clocksource calibration: 3499.995 MHz [ 4.130705] hub 4-1:1.0: USB hub found [ 4.136818] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734c8180a, max_idle_ns: 440795326857 ns [ 4.150570] clocksource: Switched to clocksource tsc [ 4.156662] hub 4-1:1.0: 6 ports detected [ 4.189948] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.203147] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.215086] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.225093] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.235292] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.247108] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ocket. Starting Setup Virtual Console... Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. [ 4.348036] uspeed USB device0;32m OK ]a…vice nodes for the current kernel. [ OK ] Started Journal Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started drac[ 4.452388] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.460831] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Starting udev Kernel Device Manager... [ 4.473209] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.536172] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.548754] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.560509] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ 4.631695] dca service started, version 1.12.1 [ 4.644658] nvme nvme0: pci function 0000:02:00.0 [ OK ] Reached target System Initialization. Starting dracut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymo[ 4.667934] igb: Intel(R) Gigabit Ethernet Network Driver uth Directory Wa[ 4.669297] nvme nvme0: 8/0/0 default/read/poll queues tch. [ [ 4.674189] igb: Copyright (c) 2007-2014 Intel Corporation. OK ] Reach[ 4.688103] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver ed target Paths.[ 4.688490] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.688953] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ OK [ 4.688957] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ] Reached t[ 4.695148] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.699654] scsi host0: ahci arget Basic Syst[ 4.730222] scsi host1: ahci [ 4.730245] ACPI: bus type drm_connector registered em. [ 4.734320] scsi host2: ahci [ 4.742636] scsi host3: ahci [ 4.742691] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 4.752936] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 4.752939] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 4.752942] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.753328] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.757645] igb 0000:07:00.0: added PHC on eth0 [ 4.757647] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.757649] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:aa:4a [ 4.757724] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.757726] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.813434] igb 0000:07:00.1: added PHC on eth1 [ 4.814581] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.819106] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.833530] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:aa:4b [ 4.833639] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.833641] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.834882] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.842367] scsi host4: ahci [ 4.864533] scsi host5: ahci [ 4.864662] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.867536] scsi host6: ahci [ 4.873933] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.876957] scsi host7: ahci [ 4.881868] ast 0000:06:00.0: [drm] Using analog VGA [ 4.884877] scsi host8: ahci [ 4.889705] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.892726] scsi host9: ahci [ 4.899542] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.902196] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.902319] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.921655] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.921657] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.921659] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.921661] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.921662] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.958820] fbcon: astdrmfb (fb0) is primary device [ 5.008134] Console: switching to colour frame buffer device 128x48 [ 5.055370] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.062259] ata1: SATA link down (SStatus 0 SControl 300) [ 5.067716] ata2: SATA link down (SStatus 0 SControl 300) [ 5.067745] ata3: SATA link down (SStatus 0 SControl 300) [ 5.078553] ata4: SATA link down (SStatus 0 SControl 300) [ 5.229919] ata10: SATA link down (SStatus 0 SControl 300) [ 5.235424] ata6: SATA link down (SStatus 0 SControl 300) [ 5.240830] ata8: SATA link down (SStatus 0 SControl 300) [ 5.246238] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.252442] ata7: SATA link down (SStatus 0 SControl 300) [ 5.257866] ata9: SATA link down (SStatus 0 SControl 300) [ 5.264019] ata5.00: NCQ Send/Recv Log not supported [ 5.268985] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.275249] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.283733] ata5.00: NCQ Send/Recv Log not supported [ 5.288695] ata5.00: configured for UDMA/133 [ 5.293098] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.305593] scsi 4:0:scsi generic sg0[ 5.314695] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.322356] sd 4:0:0:0: [sda] Write Protect is off [ 5.327147] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.347945] sda: sda1 [ 5.350551] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.837292] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.847565] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.856070] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.862248] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d7:64 [ 5.869967] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.876589] libphy: ixgbe-mdio: probed [ 6.036130] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.046407] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.054911] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.061947] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d7:65 [ 6.069643] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.076222] libphy: ixgbe-mdio: probed [ 6.080930] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.095222] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. Starting File System Check on /dev/…588-86c5-4fa7-ad82-5a8bfe76a5e8... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started File System Check on /dev/d…0b588-86c5-4fa7-ad82-5a8bfe76a5e8. Mounting /sysroot... [ 6.297125] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped target Local File Systems. Starting Setup Virtual Console... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.641560] printk: systemd: 11 output lines suppressed due to ratelimiting [ 7.228543] SELinux: policy capability network_peer_controls=1 [ 7.234462] SELinux: policy capability open_perms=1 [ 7.239422] SELinux: policy capability extended_socket_class=1 [ 7.245334] SELinux: policy capability always_check_network=0 [ 7.251156] SELinux: policy capability cgroup_seclabel=1 [ 7.256548] SELinux: policy capability nnp_nosuid_transition=1 [ 7.284127] audit: type=1403 audit(1714133562.828:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.285949] systemd[1]: Successfully loaded SELinux policy in 227.650ms. [ 7.360563] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.455ms. [ 7.378016] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.412131] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.[ 7.430008] systemd[1]: Set hostname to . 6 (Ootpa)! [ 8.452811] systemd[1]: systemd-journald.service: Succeeded. [ 8.459211] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.465412] systemd[1]: Stopped Switch Root. [ OK [[ 8.470244] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.481757] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.492417] systemd[1]: Stopped Journal Service. [ OK [[ 8.498332] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Created slice User and Session Slice. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-getty.slice. Mounting POSIX Message Queue File System... [ 8.578579] EXT4-fs (sda1): re-mounted. Opts: (null) Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on udev Control Socket. [ OK ] Reached target RPC Port Mapper. Starting Load Kernel Modules... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target Slices. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. Mounting Huge Pages File System... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... Mounting Kernel Debug File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Reached target Swap. [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Started Journal Service. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journ[ 8.809581] device-mapper: uevent: version 1.0.3 al to Persistent[ 8.815809] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Storage. [ OK ] Started udev Coldplug all Devices. [ 8.839450] fuse: init (API version 7.34) [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Restore /run/initramfs on shutdown... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC Bind... Starting Security Auditing Service... [ 9.346561] RPC: Registered named UNIX socket transport module. [ 9.352478] RPC: Registered udp transport module. [ 9.357182] RPC: Registered tcp transport module. [ 9.361879] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 9.508557] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.525553] igb 0000:07:00.0: DCA enabled [ 9.529895] IPMI message handler: version 39.2 [ 9.529900] igb 0000:07:00.1: DCA enabled [ 9.540057] ipmi device interface [ 9.549158] ipmi_si: IPMI System Interface driver [ 9.554842] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.561226] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.568644] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.574595] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.580675] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.592203] power_meter ACPI000D:00: Found ACPI power meter. [ 9.597967] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.609574] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.618273] ipmi_si: Adding ACPI-specified kcs state machine [ 9.624010] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.624169] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 9.670419] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.705605] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.712234] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.742566] iTCO_vendor_support: vendor-support=0 [ 9.752474] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.813040] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.820977] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.826645] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.832853] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.838524] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.846019] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Started Security Auditing Service. Starting Updat[ 9.859132] ipmi_si IPI0001:00: IPMI kcs interface initialized e UTMP about System Boot/Shutdown... [ 9.870586] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Kernel Samepage Merging... Starting Resets System Activity Logs... Starting Authorization Manager... [ OK ] Started Machine Check Exception Logging Daemon. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service[ 10.029054] SGI XFS with ACLs, security attributes, quota, no debug enabled instances at once. [ [ 10.038436] XFS (dm-4): Mounting V5 Filesystem OK ] Started libstoragemgmt plug-in server daemon. [[0;3[ 10.048618] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.049053] XFS (dm-4): Ending clean mount 2m OK ] Re[ 10.060692] EDAC sbridge: Ver: 1.1.2 ached target sshd-keygen.target. Starting System Security Services Daemon... [ OK ] Started irqbalance daemon. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Reached target Timers. Starting VDO volume services... Starting NTP client/server... Starting Avahi mDNS/DNS-SD Stack... [ OK ] Started LVM event activation on device 259:0. [ 10.188330] intel_rapl_common: Found RAPL domain package [ 10.193652] intel_rapl_common: Found RAPL domain dram [ 10.198702] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Mounted /var/lib/ceph. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Resets System Activity Logs. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Enable periodic update of entitlement certificates.... Starting Network Manager Wait Online... [ OK ] Started NTP client/server. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Authorization Manager. [ 12.391835] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.448882] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.456515] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.512962] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.529308] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.571858] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.680911] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.689151] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.731715] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.841001] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.965078] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started VDO volume services. [ 13.160092] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.167954] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting CUPS Scheduler... Starting Login Service... Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (10s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. [ OK ] Started Nagios Remote Plugin Executor. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... Starting /etc/rc.d/rc.local Compatibility... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started System Logging Service. + myips=172.21.15.71 + attempts=1 + sleep 1 + '[' 172.21.15.71 '!=' '' ']' + set -e + '[' -n 172.21.15.71 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.71 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.71 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi071.front.sepia.ceph.com + '[' -n smithi071.front.sepia.ceph.com ']' + hostname smithi071.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi071 + echo smithi071 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.71 smithi071.front.sepia.ceph.com smithi071\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi071 login: [disconnect] 2024-04-26T12:13:02.699 INFO:teuthology.misc:Re-opening connections... 2024-04-26T12:13:02.700 INFO:teuthology.misc:trying to connect to ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:13:02.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T12:13:02.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:13:03.635 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-26T12:13:04.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-26T12:13:04.483 DEBUG:teuthology.misc:waited 1.7837915420532227 2024-04-26T12:13:05.485 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:13:05.485 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi071.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-26T12:13:05.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:13:05.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:13:05.639 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:13:05.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:13:05.682 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:13:05.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:13:05.821 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T12:13:05.824 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:13:05.825 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T12:13:06.574 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:13:06.572+0000 7f2931be17c0 -1 Falling back to public interface 2024-04-26T12:13:08.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T12:13:10.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:no valid command found; 10 closest matches: 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:0 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:1 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:2 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:abort 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:assert 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:bluefs debug_inject_read_zeros 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:bluefs files list 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:bluefs stats 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:bluestore bluefs device info [] 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:config diff 2024-04-26T12:13:10.953 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: invalid command 2024-04-26T12:13:10.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:13:10.955 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T12:13:11.803 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:13:11.800+0000 7f2931be17c0 -1 osd.0 29 log_to_monitors true 2024-04-26T12:13:12.396 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-26T12:13:12.393+0000 7f291db71700 -1 osd.0 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:13:15.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:13:16.097 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-26T12:13:16.097 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-26T12:13:16.098 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-26T12:13:16.098 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-26T12:13:21.109 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T12:13:21.276 INFO:teuthology.orchestra.run.smithi045.stdout:mon.a: {} 2024-04-26T12:13:21.287 INFO:teuthology.orchestra.run.smithi045.stdout:mon.b: {} 2024-04-26T12:13:21.297 INFO:teuthology.orchestra.run.smithi045.stdout:mon.c: {} 2024-04-26T12:13:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:13:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:13:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:13:21.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:13:22.455 INFO:teuthology.orchestra.run.smithi045.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:13:22.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:13:23.462 INFO:teuthology.orchestra.run.smithi045.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:13:23.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:13:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:13:24.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T12:13:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T12:13:25.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:13:26.476 INFO:teuthology.orchestra.run.smithi045.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:13:26.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T12:13:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T12:13:27.497 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T12:13:27.497 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T12:13:27.497 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T12:13:27.497 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T12:13:27.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:13:27.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:13:27.864 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:27.864 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":71,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:13:27.472666+0000","last_up_change":"2024-04-26T12:13:13.374165+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":64,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":5984},{"type":"v1","addr":"172.21.15.71:6801","nonce":5984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":5984},{"type":"v1","addr":"172.21.15.71:6803","nonce":5984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":5984},{"type":"v1","addr":"172.21.15.71:6807","nonce":5984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":5984},{"type":"v1","addr":"172.21.15.71:6805","nonce":5984}]},"public_addr":"172.21.15.71:6801/5984","cluster_addr":"172.21.15.71:6803/5984","heartbeat_back_addr":"172.21.15.71:6807/5984","heartbeat_front_addr":"172.21.15.71:6805/5984","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":29},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:13:27.880 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:13:27.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:13:28.245 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:28.245 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":71,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:13:27.472666+0000","last_up_change":"2024-04-26T12:13:13.374165+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":64,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":5984},{"type":"v1","addr":"172.21.15.71:6801","nonce":5984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":5984},{"type":"v1","addr":"172.21.15.71:6803","nonce":5984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":5984},{"type":"v1","addr":"172.21.15.71:6807","nonce":5984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":5984},{"type":"v1","addr":"172.21.15.71:6805","nonce":5984}]},"public_addr":"172.21.15.71:6801/5984","cluster_addr":"172.21.15.71:6803/5984","heartbeat_back_addr":"172.21.15.71:6807/5984","heartbeat_front_addr":"172.21.15.71:6805/5984","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":29},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:13:28.261 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:13:28.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:13:28.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:13:28.450 INFO:teuthology.orchestra.run.smithi045.stdout:274877906949 2024-04-26T12:13:28.450 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:13:28.451 INFO:teuthology.orchestra.run.smithi045.stdout:34359738416 2024-04-26T12:13:28.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:13:28.452 INFO:teuthology.orchestra.run.smithi045.stdout:34359738416 2024-04-26T12:13:28.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:13:28.869 INFO:teuthology.orchestra.run.smithi045.stdout:274877906947 2024-04-26T12:13:28.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906947 for osd.0 2024-04-26T12:13:28.891 INFO:teuthology.orchestra.run.smithi045.stdout:34359738414 2024-04-26T12:13:28.900 INFO:teuthology.orchestra.run.smithi045.stdout:34359738414 2024-04-26T12:13:28.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738414 for osd.2 2024-04-26T12:13:28.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738414 for osd.1 2024-04-26T12:13:29.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:13:29.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:13:29.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:13:30.293 INFO:teuthology.orchestra.run.smithi045.stdout:274877906949 2024-04-26T12:13:30.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906949 for osd.0 2024-04-26T12:13:30.309 INFO:teuthology.orchestra.run.smithi045.stdout:34359738416 2024-04-26T12:13:30.310 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:30.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738416 for osd.2 2024-04-26T12:13:30.325 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:30.333 INFO:teuthology.orchestra.run.smithi045.stdout:34359738416 2024-04-26T12:13:30.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738416 for osd.1 2024-04-26T12:13:30.350 DEBUG:teuthology.parallel:result is None 2024-04-26T12:13:30.350 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:13:30.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:30.760 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:30.773 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-04-26T12:13:28.922429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702384,"kb_used_data":3468,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413136,"statfs":{"total":289910292480,"available":289191051264,"internally_reserved":0,"allocated":3551232,"data_stored":2091482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.463841"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556896+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:13:25.556896+0000","last_peered":"2024-04-26T12:13:25.556896+0000","last_clean":"2024-04-26T12:13:25.556896+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:25.556896+0000","last_undegraded":"2024-04-26T12:13:25.556896+0000","last_fullsized":"2024-04-26T12:13:25.556896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556602+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:25.556602+0000","last_peered":"2024-04-26T12:13:25.556602+0000","last_clean":"2024-04-26T12:13:25.556602+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:25.556602+0000","last_undegraded":"2024-04-26T12:13:25.556602+0000","last_fullsized":"2024-04-26T12:13:25.556602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470206+0000","last_change":"2024-04-26T12:13:14.393093+0000","last_active":"2024-04-26T12:13:25.470206+0000","last_peered":"2024-04-26T12:13:25.470206+0000","last_clean":"2024-04-26T12:13:25.470206+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:25.470206+0000","last_undegraded":"2024-04-26T12:13:25.470206+0000","last_fullsized":"2024-04-26T12:13:25.470206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:53.974372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469991+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:25.469991+0000","last_peered":"2024-04-26T12:13:25.469991+0000","last_clean":"2024-04-26T12:13:25.469991+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:25.469991+0000","last_undegraded":"2024-04-26T12:13:25.469991+0000","last_fullsized":"2024-04-26T12:13:25.469991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:57.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555963+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:25.555963+0000","last_peered":"2024-04-26T12:13:25.555963+0000","last_clean":"2024-04-26T12:13:25.555963+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:25.555963+0000","last_undegraded":"2024-04-26T12:13:25.555963+0000","last_fullsized":"2024-04-26T12:13:25.555963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469418+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:25.469418+0000","last_peered":"2024-04-26T12:13:25.469418+0000","last_clean":"2024-04-26T12:13:25.469418+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:25.469418+0000","last_undegraded":"2024-04-26T12:13:25.469418+0000","last_fullsized":"2024-04-26T12:13:25.469418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:21.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469383+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:25.469383+0000","last_peered":"2024-04-26T12:13:25.469383+0000","last_clean":"2024-04-26T12:13:25.469383+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:25.469383+0000","last_undegraded":"2024-04-26T12:13:25.469383+0000","last_fullsized":"2024-04-26T12:13:25.469383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:49.959427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469164+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:25.469164+0000","last_peered":"2024-04-26T12:13:25.469164+0000","last_clean":"2024-04-26T12:13:25.469164+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:25.469164+0000","last_undegraded":"2024-04-26T12:13:25.469164+0000","last_fullsized":"2024-04-26T12:13:25.469164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:03.771898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471091+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:26.471091+0000","last_peered":"2024-04-26T12:13:26.471091+0000","last_clean":"2024-04-26T12:13:26.471091+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:26.471091+0000","last_undegraded":"2024-04-26T12:13:26.471091+0000","last_fullsized":"2024-04-26T12:13:26.471091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556820+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:25.556820+0000","last_peered":"2024-04-26T12:13:25.556820+0000","last_clean":"2024-04-26T12:13:25.556820+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:25.556820+0000","last_undegraded":"2024-04-26T12:13:25.556820+0000","last_fullsized":"2024-04-26T12:13:25.556820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470312+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:25.470312+0000","last_peered":"2024-04-26T12:13:25.470312+0000","last_clean":"2024-04-26T12:13:25.470312+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:25.470312+0000","last_undegraded":"2024-04-26T12:13:25.470312+0000","last_fullsized":"2024-04-26T12:13:25.470312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:33.110932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556259+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:25.556259+0000","last_peered":"2024-04-26T12:13:25.556259+0000","last_clean":"2024-04-26T12:13:25.556259+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:25.556259+0000","last_undegraded":"2024-04-26T12:13:25.556259+0000","last_fullsized":"2024-04-26T12:13:25.556259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:29.958220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556152+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:13:25.556152+0000","last_peered":"2024-04-26T12:13:25.556152+0000","last_clean":"2024-04-26T12:13:25.556152+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:25.556152+0000","last_undegraded":"2024-04-26T12:13:25.556152+0000","last_fullsized":"2024-04-26T12:13:25.556152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469707+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:25.469707+0000","last_peered":"2024-04-26T12:13:25.469707+0000","last_clean":"2024-04-26T12:13:25.469707+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:25.469707+0000","last_undegraded":"2024-04-26T12:13:25.469707+0000","last_fullsized":"2024-04-26T12:13:25.469707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:45.547385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469637+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:25.469637+0000","last_peered":"2024-04-26T12:13:25.469637+0000","last_clean":"2024-04-26T12:13:25.469637+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:25.469637+0000","last_undegraded":"2024-04-26T12:13:25.469637+0000","last_fullsized":"2024-04-26T12:13:25.469637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469513+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:25.469513+0000","last_peered":"2024-04-26T12:13:25.469513+0000","last_clean":"2024-04-26T12:13:25.469513+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:25.469513+0000","last_undegraded":"2024-04-26T12:13:25.469513+0000","last_fullsized":"2024-04-26T12:13:25.469513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:19.229847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471104+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:26.471104+0000","last_peered":"2024-04-26T12:13:26.471104+0000","last_clean":"2024-04-26T12:13:26.471104+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:26.471104+0000","last_undegraded":"2024-04-26T12:13:26.471104+0000","last_fullsized":"2024-04-26T12:13:26.471104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556739+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:25.556739+0000","last_peered":"2024-04-26T12:13:25.556739+0000","last_clean":"2024-04-26T12:13:25.556739+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:25.556739+0000","last_undegraded":"2024-04-26T12:13:25.556739+0000","last_fullsized":"2024-04-26T12:13:25.556739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470865+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:26.470865+0000","last_peered":"2024-04-26T12:13:26.470865+0000","last_clean":"2024-04-26T12:13:26.470865+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:26.470865+0000","last_undegraded":"2024-04-26T12:13:26.470865+0000","last_fullsized":"2024-04-26T12:13:26.470865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470090+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:25.470090+0000","last_peered":"2024-04-26T12:13:25.470090+0000","last_clean":"2024-04-26T12:13:25.470090+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:25.470090+0000","last_undegraded":"2024-04-26T12:13:25.470090+0000","last_fullsized":"2024-04-26T12:13:25.470090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:07.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469579+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:25.469579+0000","last_peered":"2024-04-26T12:13:25.469579+0000","last_clean":"2024-04-26T12:13:25.469579+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:25.469579+0000","last_undegraded":"2024-04-26T12:13:25.469579+0000","last_fullsized":"2024-04-26T12:13:25.469579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:49.995173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556027+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:25.556027+0000","last_peered":"2024-04-26T12:13:25.556027+0000","last_clean":"2024-04-26T12:13:25.556027+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:25.556027+0000","last_undegraded":"2024-04-26T12:13:25.556027+0000","last_fullsized":"2024-04-26T12:13:25.556027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:21.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470536+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:26.470536+0000","last_peered":"2024-04-26T12:13:26.470536+0000","last_clean":"2024-04-26T12:13:26.470536+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:26.470536+0000","last_undegraded":"2024-04-26T12:13:26.470536+0000","last_fullsized":"2024-04-26T12:13:26.470536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556824+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:25.556824+0000","last_peered":"2024-04-26T12:13:25.556824+0000","last_clean":"2024-04-26T12:13:25.556824+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:25.556824+0000","last_undegraded":"2024-04-26T12:13:25.556824+0000","last_fullsized":"2024-04-26T12:13:25.556824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:04.826156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470956+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:26.470956+0000","last_peered":"2024-04-26T12:13:26.470956+0000","last_clean":"2024-04-26T12:13:26.470956+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:26.470956+0000","last_undegraded":"2024-04-26T12:13:26.470956+0000","last_fullsized":"2024-04-26T12:13:26.470956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:32.586178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470373+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:25.470373+0000","last_peered":"2024-04-26T12:13:25.470373+0000","last_clean":"2024-04-26T12:13:25.470373+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:25.470373+0000","last_undegraded":"2024-04-26T12:13:25.470373+0000","last_fullsized":"2024-04-26T12:13:25.470373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:43.755438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556628+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:25.556628+0000","last_peered":"2024-04-26T12:13:25.556628+0000","last_clean":"2024-04-26T12:13:25.556628+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:25.556628+0000","last_undegraded":"2024-04-26T12:13:25.556628+0000","last_fullsized":"2024-04-26T12:13:25.556628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470431+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:26.470431+0000","last_peered":"2024-04-26T12:13:26.470431+0000","last_clean":"2024-04-26T12:13:26.470431+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:26.470431+0000","last_undegraded":"2024-04-26T12:13:26.470431+0000","last_fullsized":"2024-04-26T12:13:26.470431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:33.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471084+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:26.471084+0000","last_peered":"2024-04-26T12:13:26.471084+0000","last_clean":"2024-04-26T12:13:26.471084+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:26.471084+0000","last_undegraded":"2024-04-26T12:13:26.471084+0000","last_fullsized":"2024-04-26T12:13:26.471084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.984438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470294+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:26.470294+0000","last_peered":"2024-04-26T12:13:26.470294+0000","last_clean":"2024-04-26T12:13:26.470294+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:26.470294+0000","last_undegraded":"2024-04-26T12:13:26.470294+0000","last_fullsized":"2024-04-26T12:13:26.470294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556818+0000","last_change":"2024-04-26T12:13:14.393885+0000","last_active":"2024-04-26T12:13:25.556818+0000","last_peered":"2024-04-26T12:13:25.556818+0000","last_clean":"2024-04-26T12:13:25.556818+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:25.556818+0000","last_undegraded":"2024-04-26T12:13:25.556818+0000","last_fullsized":"2024-04-26T12:13:25.556818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:37.146713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471245+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:26.471245+0000","last_peered":"2024-04-26T12:13:26.471245+0000","last_clean":"2024-04-26T12:13:26.471245+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:26.471245+0000","last_undegraded":"2024-04-26T12:13:26.471245+0000","last_fullsized":"2024-04-26T12:13:26.471245+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:07.033491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470178+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:13:26.470178+0000","last_peered":"2024-04-26T12:13:26.470178+0000","last_clean":"2024-04-26T12:13:26.470178+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:26.470178+0000","last_undegraded":"2024-04-26T12:13:26.470178+0000","last_fullsized":"2024-04-26T12:13:26.470178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470146+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:25.470146+0000","last_peered":"2024-04-26T12:13:25.470146+0000","last_clean":"2024-04-26T12:13:25.470146+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:25.470146+0000","last_undegraded":"2024-04-26T12:13:25.470146+0000","last_fullsized":"2024-04-26T12:13:25.470146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:08.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470437+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:26.470437+0000","last_peered":"2024-04-26T12:13:26.470437+0000","last_clean":"2024-04-26T12:13:26.470437+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:26.470437+0000","last_undegraded":"2024-04-26T12:13:26.470437+0000","last_fullsized":"2024-04-26T12:13:26.470437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:18.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556528+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:25.556528+0000","last_peered":"2024-04-26T12:13:25.556528+0000","last_clean":"2024-04-26T12:13:25.556528+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:25.556528+0000","last_undegraded":"2024-04-26T12:13:25.556528+0000","last_fullsized":"2024-04-26T12:13:25.556528+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:28.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470469+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:13:26.470469+0000","last_peered":"2024-04-26T12:13:26.470469+0000","last_clean":"2024-04-26T12:13:26.470469+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:26.470469+0000","last_undegraded":"2024-04-26T12:13:26.470469+0000","last_fullsized":"2024-04-26T12:13:26.470469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":31,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470033+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:25.470033+0000","last_peered":"2024-04-26T12:13:25.470033+0000","last_clean":"2024-04-26T12:13:25.470033+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:25.470033+0000","last_undegraded":"2024-04-26T12:13:25.470033+0000","last_fullsized":"2024-04-26T12:13:25.470033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:36.499448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470004+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:25.470004+0000","last_peered":"2024-04-26T12:13:25.470004+0000","last_clean":"2024-04-26T12:13:25.470004+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:25.470004+0000","last_undegraded":"2024-04-26T12:13:25.470004+0000","last_fullsized":"2024-04-26T12:13:25.470004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:06.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469561+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:25.469561+0000","last_peered":"2024-04-26T12:13:25.469561+0000","last_clean":"2024-04-26T12:13:25.469561+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:25.469561+0000","last_undegraded":"2024-04-26T12:13:25.469561+0000","last_fullsized":"2024-04-26T12:13:25.469561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.636439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556317+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:13:25.556317+0000","last_peered":"2024-04-26T12:13:25.556317+0000","last_clean":"2024-04-26T12:13:25.556317+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:25.556317+0000","last_undegraded":"2024-04-26T12:13:25.556317+0000","last_fullsized":"2024-04-26T12:13:25.556317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470356+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:26.470356+0000","last_peered":"2024-04-26T12:13:26.470356+0000","last_clean":"2024-04-26T12:13:26.470356+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:26.470356+0000","last_undegraded":"2024-04-26T12:13:26.470356+0000","last_fullsized":"2024-04-26T12:13:26.470356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:34.040588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556733+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:13:25.556733+0000","last_peered":"2024-04-26T12:13:25.556733+0000","last_clean":"2024-04-26T12:13:25.556733+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:25.556733+0000","last_undegraded":"2024-04-26T12:13:25.556733+0000","last_fullsized":"2024-04-26T12:13:25.556733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555973+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:25.555973+0000","last_peered":"2024-04-26T12:13:25.555973+0000","last_clean":"2024-04-26T12:13:25.555973+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:25.555973+0000","last_undegraded":"2024-04-26T12:13:25.555973+0000","last_fullsized":"2024-04-26T12:13:25.555973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:23.129074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471225+0000","last_change":"2024-04-26T12:13:14.392569+0000","last_active":"2024-04-26T12:13:26.471225+0000","last_peered":"2024-04-26T12:13:26.471225+0000","last_clean":"2024-04-26T12:13:26.471225+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:26.471225+0000","last_undegraded":"2024-04-26T12:13:26.471225+0000","last_fullsized":"2024-04-26T12:13:26.471225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":30,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469289+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:25.469289+0000","last_peered":"2024-04-26T12:13:25.469289+0000","last_clean":"2024-04-26T12:13:25.469289+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:25.469289+0000","last_undegraded":"2024-04-26T12:13:25.469289+0000","last_fullsized":"2024-04-26T12:13:25.469289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:07.348907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471306+0000","last_change":"2024-04-26T12:13:14.396669+0000","last_active":"2024-04-26T12:13:26.471306+0000","last_peered":"2024-04-26T12:13:26.471306+0000","last_clean":"2024-04-26T12:13:26.471306+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:26.471306+0000","last_undegraded":"2024-04-26T12:13:26.471306+0000","last_fullsized":"2024-04-26T12:13:26.471306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470330+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:25.470330+0000","last_peered":"2024-04-26T12:13:25.470330+0000","last_clean":"2024-04-26T12:13:25.470330+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:25.470330+0000","last_undegraded":"2024-04-26T12:13:25.470330+0000","last_fullsized":"2024-04-26T12:13:25.470330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555625+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:25.555625+0000","last_peered":"2024-04-26T12:13:25.555625+0000","last_clean":"2024-04-26T12:13:25.555625+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:25.555625+0000","last_undegraded":"2024-04-26T12:13:25.555625+0000","last_fullsized":"2024-04-26T12:13:25.555625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:44.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":81,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556598+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:25.556598+0000","last_peered":"2024-04-26T12:13:25.556598+0000","last_clean":"2024-04-26T12:13:25.556598+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:25.556598+0000","last_undegraded":"2024-04-26T12:13:25.556598+0000","last_fullsized":"2024-04-26T12:13:25.556598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.186277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556093+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:25.556093+0000","last_peered":"2024-04-26T12:13:25.556093+0000","last_clean":"2024-04-26T12:13:25.556093+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:25.556093+0000","last_undegraded":"2024-04-26T12:13:25.556093+0000","last_fullsized":"2024-04-26T12:13:25.556093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469954+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:25.469954+0000","last_peered":"2024-04-26T12:13:25.469954+0000","last_clean":"2024-04-26T12:13:25.469954+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:25.469954+0000","last_undegraded":"2024-04-26T12:13:25.469954+0000","last_fullsized":"2024-04-26T12:13:25.469954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:29.651436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469598+0000","last_change":"2024-04-26T12:13:14.392806+0000","last_active":"2024-04-26T12:13:25.469598+0000","last_peered":"2024-04-26T12:13:25.469598+0000","last_clean":"2024-04-26T12:13:25.469598+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:25.469598+0000","last_undegraded":"2024-04-26T12:13:25.469598+0000","last_fullsized":"2024-04-26T12:13:25.469598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:27.472246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470144+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:25.470144+0000","last_peered":"2024-04-26T12:13:25.470144+0000","last_clean":"2024-04-26T12:13:25.470144+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:25.470144+0000","last_undegraded":"2024-04-26T12:13:25.470144+0000","last_fullsized":"2024-04-26T12:13:25.470144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:43.465677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470638+0000","last_change":"2024-04-26T12:13:14.396914+0000","last_active":"2024-04-26T12:13:26.470638+0000","last_peered":"2024-04-26T12:13:26.470638+0000","last_clean":"2024-04-26T12:13:26.470638+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:26.470638+0000","last_undegraded":"2024-04-26T12:13:26.470638+0000","last_fullsized":"2024-04-26T12:13:26.470638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:33.086082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470602+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:26.470602+0000","last_peered":"2024-04-26T12:13:26.470602+0000","last_clean":"2024-04-26T12:13:26.470602+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:26.470602+0000","last_undegraded":"2024-04-26T12:13:26.470602+0000","last_fullsized":"2024-04-26T12:13:26.470602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:42.180071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469889+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:25.469889+0000","last_peered":"2024-04-26T12:13:25.469889+0000","last_clean":"2024-04-26T12:13:25.469889+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:25.469889+0000","last_undegraded":"2024-04-26T12:13:25.469889+0000","last_fullsized":"2024-04-26T12:13:25.469889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:16.727025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469510+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:25.469510+0000","last_peered":"2024-04-26T12:13:25.469510+0000","last_clean":"2024-04-26T12:13:25.469510+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:25.469510+0000","last_undegraded":"2024-04-26T12:13:25.469510+0000","last_fullsized":"2024-04-26T12:13:25.469510+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:39.928988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470349+0000","last_change":"2024-04-26T12:13:14.394506+0000","last_active":"2024-04-26T12:13:25.470349+0000","last_peered":"2024-04-26T12:13:25.470349+0000","last_clean":"2024-04-26T12:13:25.470349+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:25.470349+0000","last_undegraded":"2024-04-26T12:13:25.470349+0000","last_fullsized":"2024-04-26T12:13:25.470349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:14.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555820+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:25.555820+0000","last_peered":"2024-04-26T12:13:25.555820+0000","last_clean":"2024-04-26T12:13:25.555820+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:25.555820+0000","last_undegraded":"2024-04-26T12:13:25.555820+0000","last_fullsized":"2024-04-26T12:13:25.555820+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:24.717066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470241+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:25.470241+0000","last_peered":"2024-04-26T12:13:25.470241+0000","last_clean":"2024-04-26T12:13:25.470241+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:25.470241+0000","last_undegraded":"2024-04-26T12:13:25.470241+0000","last_fullsized":"2024-04-26T12:13:25.470241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:48.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":66,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555783+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:25.555783+0000","last_peered":"2024-04-26T12:13:25.555783+0000","last_clean":"2024-04-26T12:13:25.555783+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:25.555783+0000","last_undegraded":"2024-04-26T12:13:25.555783+0000","last_fullsized":"2024-04-26T12:13:25.555783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471174+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:26.471174+0000","last_peered":"2024-04-26T12:13:26.471174+0000","last_clean":"2024-04-26T12:13:26.471174+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:26.471174+0000","last_undegraded":"2024-04-26T12:13:26.471174+0000","last_fullsized":"2024-04-26T12:13:26.471174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471166+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:26.471166+0000","last_peered":"2024-04-26T12:13:26.471166+0000","last_clean":"2024-04-26T12:13:26.471166+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:26.471166+0000","last_undegraded":"2024-04-26T12:13:26.471166+0000","last_fullsized":"2024-04-26T12:13:26.471166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556578+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:25.556578+0000","last_peered":"2024-04-26T12:13:25.556578+0000","last_clean":"2024-04-26T12:13:25.556578+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:25.556578+0000","last_undegraded":"2024-04-26T12:13:25.556578+0000","last_fullsized":"2024-04-26T12:13:25.556578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470220+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:26.470220+0000","last_peered":"2024-04-26T12:13:26.470220+0000","last_clean":"2024-04-26T12:13:26.470220+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:26.470220+0000","last_undegraded":"2024-04-26T12:13:26.470220+0000","last_fullsized":"2024-04-26T12:13:26.470220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:31.826247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556329+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:25.556329+0000","last_peered":"2024-04-26T12:13:25.556329+0000","last_clean":"2024-04-26T12:13:25.556329+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:25.556329+0000","last_undegraded":"2024-04-26T12:13:25.556329+0000","last_fullsized":"2024-04-26T12:13:25.556329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:45.968725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471078+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:26.471078+0000","last_peered":"2024-04-26T12:13:26.471078+0000","last_clean":"2024-04-26T12:13:26.471078+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:26.471078+0000","last_undegraded":"2024-04-26T12:13:26.471078+0000","last_fullsized":"2024-04-26T12:13:26.471078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:01.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:52.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470700+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:26.470700+0000","last_peered":"2024-04-26T12:13:26.470700+0000","last_clean":"2024-04-26T12:13:26.470700+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:26.470700+0000","last_undegraded":"2024-04-26T12:13:26.470700+0000","last_fullsized":"2024-04-26T12:13:26.470700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:19.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":220,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469243+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:25.469243+0000","last_peered":"2024-04-26T12:13:25.469243+0000","last_clean":"2024-04-26T12:13:25.469243+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:25.469243+0000","last_undegraded":"2024-04-26T12:13:25.469243+0000","last_fullsized":"2024-04-26T12:13:25.469243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:35.149994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470231+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:26.470231+0000","last_peered":"2024-04-26T12:13:26.470231+0000","last_clean":"2024-04-26T12:13:26.470231+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:26.470231+0000","last_undegraded":"2024-04-26T12:13:26.470231+0000","last_fullsized":"2024-04-26T12:13:26.470231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:51.595471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556850+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:13:25.556850+0000","last_peered":"2024-04-26T12:13:25.556850+0000","last_clean":"2024-04-26T12:13:25.556850+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:25.556850+0000","last_undegraded":"2024-04-26T12:13:25.556850+0000","last_fullsized":"2024-04-26T12:13:25.556850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469686+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:25.469686+0000","last_peered":"2024-04-26T12:13:25.469686+0000","last_clean":"2024-04-26T12:13:25.469686+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:25.469686+0000","last_undegraded":"2024-04-26T12:13:25.469686+0000","last_fullsized":"2024-04-26T12:13:25.469686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.093761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555755+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:25.555755+0000","last_peered":"2024-04-26T12:13:25.555755+0000","last_clean":"2024-04-26T12:13:25.555755+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:25.555755+0000","last_undegraded":"2024-04-26T12:13:25.555755+0000","last_fullsized":"2024-04-26T12:13:25.555755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:22.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469453+0000","last_change":"2024-04-26T12:13:14.392269+0000","last_active":"2024-04-26T12:13:25.469453+0000","last_peered":"2024-04-26T12:13:25.469453+0000","last_clean":"2024-04-26T12:13:25.469453+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:25.469453+0000","last_undegraded":"2024-04-26T12:13:25.469453+0000","last_fullsized":"2024-04-26T12:13:25.469453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:55.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470399+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:26.470399+0000","last_peered":"2024-04-26T12:13:26.470399+0000","last_clean":"2024-04-26T12:13:26.470399+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:26.470399+0000","last_undegraded":"2024-04-26T12:13:26.470399+0000","last_fullsized":"2024-04-26T12:13:26.470399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470084+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:25.470084+0000","last_peered":"2024-04-26T12:13:25.470084+0000","last_clean":"2024-04-26T12:13:25.470084+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:25.470084+0000","last_undegraded":"2024-04-26T12:13:25.470084+0000","last_fullsized":"2024-04-26T12:13:25.470084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:24.319975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555821+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:25.555821+0000","last_peered":"2024-04-26T12:13:25.555821+0000","last_clean":"2024-04-26T12:13:25.555821+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:25.555821+0000","last_undegraded":"2024-04-26T12:13:25.555821+0000","last_fullsized":"2024-04-26T12:13:25.555821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469673+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:25.469673+0000","last_peered":"2024-04-26T12:13:25.469673+0000","last_clean":"2024-04-26T12:13:25.469673+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:25.469673+0000","last_undegraded":"2024-04-26T12:13:25.469673+0000","last_fullsized":"2024-04-26T12:13:25.469673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:03.736741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470868+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:26.470868+0000","last_peered":"2024-04-26T12:13:26.470868+0000","last_clean":"2024-04-26T12:13:26.470868+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:26.470868+0000","last_undegraded":"2024-04-26T12:13:26.470868+0000","last_fullsized":"2024-04-26T12:13:26.470868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556723+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:25.556723+0000","last_peered":"2024-04-26T12:13:25.556723+0000","last_clean":"2024-04-26T12:13:25.556723+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:25.556723+0000","last_undegraded":"2024-04-26T12:13:25.556723+0000","last_fullsized":"2024-04-26T12:13:25.556723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:57.924425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470966+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:26.470966+0000","last_peered":"2024-04-26T12:13:26.470966+0000","last_clean":"2024-04-26T12:13:26.470966+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:26.470966+0000","last_undegraded":"2024-04-26T12:13:26.470966+0000","last_fullsized":"2024-04-26T12:13:26.470966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470035+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:25.470035+0000","last_peered":"2024-04-26T12:13:25.470035+0000","last_clean":"2024-04-26T12:13:25.470035+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:25.470035+0000","last_undegraded":"2024-04-26T12:13:25.470035+0000","last_fullsized":"2024-04-26T12:13:25.470035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:17.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470195+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:25.470195+0000","last_peered":"2024-04-26T12:13:25.470195+0000","last_clean":"2024-04-26T12:13:25.470195+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:25.470195+0000","last_undegraded":"2024-04-26T12:13:25.470195+0000","last_fullsized":"2024-04-26T12:13:25.470195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:30.589803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556118+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:25.556118+0000","last_peered":"2024-04-26T12:13:25.556118+0000","last_clean":"2024-04-26T12:13:25.556118+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:25.556118+0000","last_undegraded":"2024-04-26T12:13:25.556118+0000","last_fullsized":"2024-04-26T12:13:25.556118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556109+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:25.556109+0000","last_peered":"2024-04-26T12:13:25.556109+0000","last_clean":"2024-04-26T12:13:25.556109+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:25.556109+0000","last_undegraded":"2024-04-26T12:13:25.556109+0000","last_fullsized":"2024-04-26T12:13:25.556109+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556413+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:25.556413+0000","last_peered":"2024-04-26T12:13:25.556413+0000","last_clean":"2024-04-26T12:13:25.556413+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:25.556413+0000","last_undegraded":"2024-04-26T12:13:25.556413+0000","last_fullsized":"2024-04-26T12:13:25.556413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469843+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:25.469843+0000","last_peered":"2024-04-26T12:13:25.469843+0000","last_clean":"2024-04-26T12:13:25.469843+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:25.469843+0000","last_undegraded":"2024-04-26T12:13:25.469843+0000","last_fullsized":"2024-04-26T12:13:25.469843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.214997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469946+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:25.469946+0000","last_peered":"2024-04-26T12:13:25.469946+0000","last_clean":"2024-04-26T12:13:25.469946+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:25.469946+0000","last_undegraded":"2024-04-26T12:13:25.469946+0000","last_fullsized":"2024-04-26T12:13:25.469946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.878980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":35,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469967+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:25.469967+0000","last_peered":"2024-04-26T12:13:25.469967+0000","last_clean":"2024-04-26T12:13:25.469967+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:25.469967+0000","last_undegraded":"2024-04-26T12:13:25.469967+0000","last_fullsized":"2024-04-26T12:13:25.469967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:33.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469576+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:25.469576+0000","last_peered":"2024-04-26T12:13:25.469576+0000","last_clean":"2024-04-26T12:13:25.469576+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:25.469576+0000","last_undegraded":"2024-04-26T12:13:25.469576+0000","last_fullsized":"2024-04-26T12:13:25.469576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:25.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471000+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:26.471000+0000","last_peered":"2024-04-26T12:13:26.471000+0000","last_clean":"2024-04-26T12:13:26.471000+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:26.471000+0000","last_undegraded":"2024-04-26T12:13:26.471000+0000","last_fullsized":"2024-04-26T12:13:26.471000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556129+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:25.556129+0000","last_peered":"2024-04-26T12:13:25.556129+0000","last_clean":"2024-04-26T12:13:25.556129+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:25.556129+0000","last_undegraded":"2024-04-26T12:13:25.556129+0000","last_fullsized":"2024-04-26T12:13:25.556129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.396440+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469405+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:25.469405+0000","last_peered":"2024-04-26T12:13:25.469405+0000","last_clean":"2024-04-26T12:13:25.469405+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:25.469405+0000","last_undegraded":"2024-04-26T12:13:25.469405+0000","last_fullsized":"2024-04-26T12:13:25.469405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:25.593914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469336+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:25.469336+0000","last_peered":"2024-04-26T12:13:25.469336+0000","last_clean":"2024-04-26T12:13:25.469336+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:25.469336+0000","last_undegraded":"2024-04-26T12:13:25.469336+0000","last_fullsized":"2024-04-26T12:13:25.469336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470322+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:13:26.470322+0000","last_peered":"2024-04-26T12:13:26.470322+0000","last_clean":"2024-04-26T12:13:26.470322+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:26.470322+0000","last_undegraded":"2024-04-26T12:13:26.470322+0000","last_fullsized":"2024-04-26T12:13:26.470322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556132+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:25.556132+0000","last_peered":"2024-04-26T12:13:25.556132+0000","last_clean":"2024-04-26T12:13:25.556132+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:25.556132+0000","last_undegraded":"2024-04-26T12:13:25.556132+0000","last_fullsized":"2024-04-26T12:13:25.556132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:48.553812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470936+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:26.470936+0000","last_peered":"2024-04-26T12:13:26.470936+0000","last_clean":"2024-04-26T12:13:26.470936+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:26.470936+0000","last_undegraded":"2024-04-26T12:13:26.470936+0000","last_fullsized":"2024-04-26T12:13:26.470936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556493+0000","last_change":"2024-04-26T12:13:14.394918+0000","last_active":"2024-04-26T12:13:25.556493+0000","last_peered":"2024-04-26T12:13:25.556493+0000","last_clean":"2024-04-26T12:13:25.556493+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:25.556493+0000","last_undegraded":"2024-04-26T12:13:25.556493+0000","last_fullsized":"2024-04-26T12:13:25.556493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002812,"statfs":{"total":96636764160,"available":96258879488,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.55900000000000005}]}]},{"osd":0,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289228,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082612,"statfs":{"total":96636764160,"available":96340594688,"internally_reserved":0,"allocated":1376256,"data_stored":889844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Apr 26 12:12:49 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.76900000000000002,"5min":2.214,"15min":2.214},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.42499999999999999},"min":{"1min":0.19500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.8440000000000001,"5min":2.294,"15min":2.294},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:30.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:31.185 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:31.187 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:31.199 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-26T12:13:30.922997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702384,"kb_used_data":3468,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413136,"statfs":{"total":289910292480,"available":289191051264,"internally_reserved":0,"allocated":3551232,"data_stored":2091482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556896+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:13:25.556896+0000","last_peered":"2024-04-26T12:13:25.556896+0000","last_clean":"2024-04-26T12:13:25.556896+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:25.556896+0000","last_undegraded":"2024-04-26T12:13:25.556896+0000","last_fullsized":"2024-04-26T12:13:25.556896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556602+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:25.556602+0000","last_peered":"2024-04-26T12:13:25.556602+0000","last_clean":"2024-04-26T12:13:25.556602+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:25.556602+0000","last_undegraded":"2024-04-26T12:13:25.556602+0000","last_fullsized":"2024-04-26T12:13:25.556602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470206+0000","last_change":"2024-04-26T12:13:14.393093+0000","last_active":"2024-04-26T12:13:25.470206+0000","last_peered":"2024-04-26T12:13:25.470206+0000","last_clean":"2024-04-26T12:13:25.470206+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:25.470206+0000","last_undegraded":"2024-04-26T12:13:25.470206+0000","last_fullsized":"2024-04-26T12:13:25.470206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:53.974372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469991+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:25.469991+0000","last_peered":"2024-04-26T12:13:25.469991+0000","last_clean":"2024-04-26T12:13:25.469991+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:25.469991+0000","last_undegraded":"2024-04-26T12:13:25.469991+0000","last_fullsized":"2024-04-26T12:13:25.469991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:57.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555963+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:25.555963+0000","last_peered":"2024-04-26T12:13:25.555963+0000","last_clean":"2024-04-26T12:13:25.555963+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:25.555963+0000","last_undegraded":"2024-04-26T12:13:25.555963+0000","last_fullsized":"2024-04-26T12:13:25.555963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469418+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:25.469418+0000","last_peered":"2024-04-26T12:13:25.469418+0000","last_clean":"2024-04-26T12:13:25.469418+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:25.469418+0000","last_undegraded":"2024-04-26T12:13:25.469418+0000","last_fullsized":"2024-04-26T12:13:25.469418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:21.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469383+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:25.469383+0000","last_peered":"2024-04-26T12:13:25.469383+0000","last_clean":"2024-04-26T12:13:25.469383+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:25.469383+0000","last_undegraded":"2024-04-26T12:13:25.469383+0000","last_fullsized":"2024-04-26T12:13:25.469383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:49.959427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469164+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:25.469164+0000","last_peered":"2024-04-26T12:13:25.469164+0000","last_clean":"2024-04-26T12:13:25.469164+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:25.469164+0000","last_undegraded":"2024-04-26T12:13:25.469164+0000","last_fullsized":"2024-04-26T12:13:25.469164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:03.771898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471091+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:26.471091+0000","last_peered":"2024-04-26T12:13:26.471091+0000","last_clean":"2024-04-26T12:13:26.471091+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:26.471091+0000","last_undegraded":"2024-04-26T12:13:26.471091+0000","last_fullsized":"2024-04-26T12:13:26.471091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556820+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:25.556820+0000","last_peered":"2024-04-26T12:13:25.556820+0000","last_clean":"2024-04-26T12:13:25.556820+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:25.556820+0000","last_undegraded":"2024-04-26T12:13:25.556820+0000","last_fullsized":"2024-04-26T12:13:25.556820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470312+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:25.470312+0000","last_peered":"2024-04-26T12:13:25.470312+0000","last_clean":"2024-04-26T12:13:25.470312+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:25.470312+0000","last_undegraded":"2024-04-26T12:13:25.470312+0000","last_fullsized":"2024-04-26T12:13:25.470312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:33.110932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556259+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:25.556259+0000","last_peered":"2024-04-26T12:13:25.556259+0000","last_clean":"2024-04-26T12:13:25.556259+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:25.556259+0000","last_undegraded":"2024-04-26T12:13:25.556259+0000","last_fullsized":"2024-04-26T12:13:25.556259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:29.958220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556152+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:13:25.556152+0000","last_peered":"2024-04-26T12:13:25.556152+0000","last_clean":"2024-04-26T12:13:25.556152+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:25.556152+0000","last_undegraded":"2024-04-26T12:13:25.556152+0000","last_fullsized":"2024-04-26T12:13:25.556152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469707+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:25.469707+0000","last_peered":"2024-04-26T12:13:25.469707+0000","last_clean":"2024-04-26T12:13:25.469707+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:25.469707+0000","last_undegraded":"2024-04-26T12:13:25.469707+0000","last_fullsized":"2024-04-26T12:13:25.469707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:45.547385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469637+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:25.469637+0000","last_peered":"2024-04-26T12:13:25.469637+0000","last_clean":"2024-04-26T12:13:25.469637+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:25.469637+0000","last_undegraded":"2024-04-26T12:13:25.469637+0000","last_fullsized":"2024-04-26T12:13:25.469637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469513+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:25.469513+0000","last_peered":"2024-04-26T12:13:25.469513+0000","last_clean":"2024-04-26T12:13:25.469513+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:25.469513+0000","last_undegraded":"2024-04-26T12:13:25.469513+0000","last_fullsized":"2024-04-26T12:13:25.469513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:19.229847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471104+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:26.471104+0000","last_peered":"2024-04-26T12:13:26.471104+0000","last_clean":"2024-04-26T12:13:26.471104+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:26.471104+0000","last_undegraded":"2024-04-26T12:13:26.471104+0000","last_fullsized":"2024-04-26T12:13:26.471104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556739+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:25.556739+0000","last_peered":"2024-04-26T12:13:25.556739+0000","last_clean":"2024-04-26T12:13:25.556739+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:25.556739+0000","last_undegraded":"2024-04-26T12:13:25.556739+0000","last_fullsized":"2024-04-26T12:13:25.556739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470865+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:26.470865+0000","last_peered":"2024-04-26T12:13:26.470865+0000","last_clean":"2024-04-26T12:13:26.470865+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:26.470865+0000","last_undegraded":"2024-04-26T12:13:26.470865+0000","last_fullsized":"2024-04-26T12:13:26.470865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470090+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:25.470090+0000","last_peered":"2024-04-26T12:13:25.470090+0000","last_clean":"2024-04-26T12:13:25.470090+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:25.470090+0000","last_undegraded":"2024-04-26T12:13:25.470090+0000","last_fullsized":"2024-04-26T12:13:25.470090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:07.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469579+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:25.469579+0000","last_peered":"2024-04-26T12:13:25.469579+0000","last_clean":"2024-04-26T12:13:25.469579+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:25.469579+0000","last_undegraded":"2024-04-26T12:13:25.469579+0000","last_fullsized":"2024-04-26T12:13:25.469579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:49.995173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556027+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:25.556027+0000","last_peered":"2024-04-26T12:13:25.556027+0000","last_clean":"2024-04-26T12:13:25.556027+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:25.556027+0000","last_undegraded":"2024-04-26T12:13:25.556027+0000","last_fullsized":"2024-04-26T12:13:25.556027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:21.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470536+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:26.470536+0000","last_peered":"2024-04-26T12:13:26.470536+0000","last_clean":"2024-04-26T12:13:26.470536+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:26.470536+0000","last_undegraded":"2024-04-26T12:13:26.470536+0000","last_fullsized":"2024-04-26T12:13:26.470536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556824+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:25.556824+0000","last_peered":"2024-04-26T12:13:25.556824+0000","last_clean":"2024-04-26T12:13:25.556824+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:25.556824+0000","last_undegraded":"2024-04-26T12:13:25.556824+0000","last_fullsized":"2024-04-26T12:13:25.556824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:04.826156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470956+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:26.470956+0000","last_peered":"2024-04-26T12:13:26.470956+0000","last_clean":"2024-04-26T12:13:26.470956+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:26.470956+0000","last_undegraded":"2024-04-26T12:13:26.470956+0000","last_fullsized":"2024-04-26T12:13:26.470956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:32.586178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470373+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:25.470373+0000","last_peered":"2024-04-26T12:13:25.470373+0000","last_clean":"2024-04-26T12:13:25.470373+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:25.470373+0000","last_undegraded":"2024-04-26T12:13:25.470373+0000","last_fullsized":"2024-04-26T12:13:25.470373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:43.755438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556628+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:25.556628+0000","last_peered":"2024-04-26T12:13:25.556628+0000","last_clean":"2024-04-26T12:13:25.556628+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:25.556628+0000","last_undegraded":"2024-04-26T12:13:25.556628+0000","last_fullsized":"2024-04-26T12:13:25.556628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470431+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:26.470431+0000","last_peered":"2024-04-26T12:13:26.470431+0000","last_clean":"2024-04-26T12:13:26.470431+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:26.470431+0000","last_undegraded":"2024-04-26T12:13:26.470431+0000","last_fullsized":"2024-04-26T12:13:26.470431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:33.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471084+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:26.471084+0000","last_peered":"2024-04-26T12:13:26.471084+0000","last_clean":"2024-04-26T12:13:26.471084+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:26.471084+0000","last_undegraded":"2024-04-26T12:13:26.471084+0000","last_fullsized":"2024-04-26T12:13:26.471084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.984438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470294+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:26.470294+0000","last_peered":"2024-04-26T12:13:26.470294+0000","last_clean":"2024-04-26T12:13:26.470294+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:26.470294+0000","last_undegraded":"2024-04-26T12:13:26.470294+0000","last_fullsized":"2024-04-26T12:13:26.470294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556818+0000","last_change":"2024-04-26T12:13:14.393885+0000","last_active":"2024-04-26T12:13:25.556818+0000","last_peered":"2024-04-26T12:13:25.556818+0000","last_clean":"2024-04-26T12:13:25.556818+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:25.556818+0000","last_undegraded":"2024-04-26T12:13:25.556818+0000","last_fullsized":"2024-04-26T12:13:25.556818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:37.146713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471245+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:26.471245+0000","last_peered":"2024-04-26T12:13:26.471245+0000","last_clean":"2024-04-26T12:13:26.471245+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:26.471245+0000","last_undegraded":"2024-04-26T12:13:26.471245+0000","last_fullsized":"2024-04-26T12:13:26.471245+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:07.033491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470178+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:13:26.470178+0000","last_peered":"2024-04-26T12:13:26.470178+0000","last_clean":"2024-04-26T12:13:26.470178+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:26.470178+0000","last_undegraded":"2024-04-26T12:13:26.470178+0000","last_fullsized":"2024-04-26T12:13:26.470178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470146+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:25.470146+0000","last_peered":"2024-04-26T12:13:25.470146+0000","last_clean":"2024-04-26T12:13:25.470146+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:25.470146+0000","last_undegraded":"2024-04-26T12:13:25.470146+0000","last_fullsized":"2024-04-26T12:13:25.470146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:08.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470437+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:26.470437+0000","last_peered":"2024-04-26T12:13:26.470437+0000","last_clean":"2024-04-26T12:13:26.470437+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:26.470437+0000","last_undegraded":"2024-04-26T12:13:26.470437+0000","last_fullsized":"2024-04-26T12:13:26.470437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:18.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556528+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:25.556528+0000","last_peered":"2024-04-26T12:13:25.556528+0000","last_clean":"2024-04-26T12:13:25.556528+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:25.556528+0000","last_undegraded":"2024-04-26T12:13:25.556528+0000","last_fullsized":"2024-04-26T12:13:25.556528+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:28.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470469+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:13:26.470469+0000","last_peered":"2024-04-26T12:13:26.470469+0000","last_clean":"2024-04-26T12:13:26.470469+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:26.470469+0000","last_undegraded":"2024-04-26T12:13:26.470469+0000","last_fullsized":"2024-04-26T12:13:26.470469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":31,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470033+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:25.470033+0000","last_peered":"2024-04-26T12:13:25.470033+0000","last_clean":"2024-04-26T12:13:25.470033+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:25.470033+0000","last_undegraded":"2024-04-26T12:13:25.470033+0000","last_fullsized":"2024-04-26T12:13:25.470033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:36.499448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470004+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:25.470004+0000","last_peered":"2024-04-26T12:13:25.470004+0000","last_clean":"2024-04-26T12:13:25.470004+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:25.470004+0000","last_undegraded":"2024-04-26T12:13:25.470004+0000","last_fullsized":"2024-04-26T12:13:25.470004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:06.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469561+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:25.469561+0000","last_peered":"2024-04-26T12:13:25.469561+0000","last_clean":"2024-04-26T12:13:25.469561+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:25.469561+0000","last_undegraded":"2024-04-26T12:13:25.469561+0000","last_fullsized":"2024-04-26T12:13:25.469561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.636439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556317+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:13:25.556317+0000","last_peered":"2024-04-26T12:13:25.556317+0000","last_clean":"2024-04-26T12:13:25.556317+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:25.556317+0000","last_undegraded":"2024-04-26T12:13:25.556317+0000","last_fullsized":"2024-04-26T12:13:25.556317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470356+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:26.470356+0000","last_peered":"2024-04-26T12:13:26.470356+0000","last_clean":"2024-04-26T12:13:26.470356+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:26.470356+0000","last_undegraded":"2024-04-26T12:13:26.470356+0000","last_fullsized":"2024-04-26T12:13:26.470356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:34.040588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556733+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:13:25.556733+0000","last_peered":"2024-04-26T12:13:25.556733+0000","last_clean":"2024-04-26T12:13:25.556733+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:25.556733+0000","last_undegraded":"2024-04-26T12:13:25.556733+0000","last_fullsized":"2024-04-26T12:13:25.556733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555973+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:25.555973+0000","last_peered":"2024-04-26T12:13:25.555973+0000","last_clean":"2024-04-26T12:13:25.555973+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:25.555973+0000","last_undegraded":"2024-04-26T12:13:25.555973+0000","last_fullsized":"2024-04-26T12:13:25.555973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:23.129074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471225+0000","last_change":"2024-04-26T12:13:14.392569+0000","last_active":"2024-04-26T12:13:26.471225+0000","last_peered":"2024-04-26T12:13:26.471225+0000","last_clean":"2024-04-26T12:13:26.471225+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:26.471225+0000","last_undegraded":"2024-04-26T12:13:26.471225+0000","last_fullsized":"2024-04-26T12:13:26.471225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":30,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469289+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:25.469289+0000","last_peered":"2024-04-26T12:13:25.469289+0000","last_clean":"2024-04-26T12:13:25.469289+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:25.469289+0000","last_undegraded":"2024-04-26T12:13:25.469289+0000","last_fullsized":"2024-04-26T12:13:25.469289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:07.348907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471306+0000","last_change":"2024-04-26T12:13:14.396669+0000","last_active":"2024-04-26T12:13:26.471306+0000","last_peered":"2024-04-26T12:13:26.471306+0000","last_clean":"2024-04-26T12:13:26.471306+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:26.471306+0000","last_undegraded":"2024-04-26T12:13:26.471306+0000","last_fullsized":"2024-04-26T12:13:26.471306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470330+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:25.470330+0000","last_peered":"2024-04-26T12:13:25.470330+0000","last_clean":"2024-04-26T12:13:25.470330+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:25.470330+0000","last_undegraded":"2024-04-26T12:13:25.470330+0000","last_fullsized":"2024-04-26T12:13:25.470330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555625+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:25.555625+0000","last_peered":"2024-04-26T12:13:25.555625+0000","last_clean":"2024-04-26T12:13:25.555625+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:25.555625+0000","last_undegraded":"2024-04-26T12:13:25.555625+0000","last_fullsized":"2024-04-26T12:13:25.555625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:44.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":81,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556598+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:25.556598+0000","last_peered":"2024-04-26T12:13:25.556598+0000","last_clean":"2024-04-26T12:13:25.556598+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:25.556598+0000","last_undegraded":"2024-04-26T12:13:25.556598+0000","last_fullsized":"2024-04-26T12:13:25.556598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.186277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556093+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:25.556093+0000","last_peered":"2024-04-26T12:13:25.556093+0000","last_clean":"2024-04-26T12:13:25.556093+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:25.556093+0000","last_undegraded":"2024-04-26T12:13:25.556093+0000","last_fullsized":"2024-04-26T12:13:25.556093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469954+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:25.469954+0000","last_peered":"2024-04-26T12:13:25.469954+0000","last_clean":"2024-04-26T12:13:25.469954+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:25.469954+0000","last_undegraded":"2024-04-26T12:13:25.469954+0000","last_fullsized":"2024-04-26T12:13:25.469954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:29.651436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469598+0000","last_change":"2024-04-26T12:13:14.392806+0000","last_active":"2024-04-26T12:13:25.469598+0000","last_peered":"2024-04-26T12:13:25.469598+0000","last_clean":"2024-04-26T12:13:25.469598+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:25.469598+0000","last_undegraded":"2024-04-26T12:13:25.469598+0000","last_fullsized":"2024-04-26T12:13:25.469598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:27.472246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470144+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:25.470144+0000","last_peered":"2024-04-26T12:13:25.470144+0000","last_clean":"2024-04-26T12:13:25.470144+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:25.470144+0000","last_undegraded":"2024-04-26T12:13:25.470144+0000","last_fullsized":"2024-04-26T12:13:25.470144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:43.465677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470638+0000","last_change":"2024-04-26T12:13:14.396914+0000","last_active":"2024-04-26T12:13:26.470638+0000","last_peered":"2024-04-26T12:13:26.470638+0000","last_clean":"2024-04-26T12:13:26.470638+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:26.470638+0000","last_undegraded":"2024-04-26T12:13:26.470638+0000","last_fullsized":"2024-04-26T12:13:26.470638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:33.086082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470602+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:26.470602+0000","last_peered":"2024-04-26T12:13:26.470602+0000","last_clean":"2024-04-26T12:13:26.470602+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:26.470602+0000","last_undegraded":"2024-04-26T12:13:26.470602+0000","last_fullsized":"2024-04-26T12:13:26.470602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:42.180071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469889+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:25.469889+0000","last_peered":"2024-04-26T12:13:25.469889+0000","last_clean":"2024-04-26T12:13:25.469889+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:25.469889+0000","last_undegraded":"2024-04-26T12:13:25.469889+0000","last_fullsized":"2024-04-26T12:13:25.469889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:16.727025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469510+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:25.469510+0000","last_peered":"2024-04-26T12:13:25.469510+0000","last_clean":"2024-04-26T12:13:25.469510+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:25.469510+0000","last_undegraded":"2024-04-26T12:13:25.469510+0000","last_fullsized":"2024-04-26T12:13:25.469510+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:39.928988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470349+0000","last_change":"2024-04-26T12:13:14.394506+0000","last_active":"2024-04-26T12:13:25.470349+0000","last_peered":"2024-04-26T12:13:25.470349+0000","last_clean":"2024-04-26T12:13:25.470349+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:25.470349+0000","last_undegraded":"2024-04-26T12:13:25.470349+0000","last_fullsized":"2024-04-26T12:13:25.470349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:14.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555820+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:25.555820+0000","last_peered":"2024-04-26T12:13:25.555820+0000","last_clean":"2024-04-26T12:13:25.555820+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:25.555820+0000","last_undegraded":"2024-04-26T12:13:25.555820+0000","last_fullsized":"2024-04-26T12:13:25.555820+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:24.717066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470241+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:25.470241+0000","last_peered":"2024-04-26T12:13:25.470241+0000","last_clean":"2024-04-26T12:13:25.470241+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:25.470241+0000","last_undegraded":"2024-04-26T12:13:25.470241+0000","last_fullsized":"2024-04-26T12:13:25.470241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:48.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":66,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555783+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:25.555783+0000","last_peered":"2024-04-26T12:13:25.555783+0000","last_clean":"2024-04-26T12:13:25.555783+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:25.555783+0000","last_undegraded":"2024-04-26T12:13:25.555783+0000","last_fullsized":"2024-04-26T12:13:25.555783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471174+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:26.471174+0000","last_peered":"2024-04-26T12:13:26.471174+0000","last_clean":"2024-04-26T12:13:26.471174+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:26.471174+0000","last_undegraded":"2024-04-26T12:13:26.471174+0000","last_fullsized":"2024-04-26T12:13:26.471174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471166+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:26.471166+0000","last_peered":"2024-04-26T12:13:26.471166+0000","last_clean":"2024-04-26T12:13:26.471166+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:26.471166+0000","last_undegraded":"2024-04-26T12:13:26.471166+0000","last_fullsized":"2024-04-26T12:13:26.471166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556578+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:25.556578+0000","last_peered":"2024-04-26T12:13:25.556578+0000","last_clean":"2024-04-26T12:13:25.556578+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:25.556578+0000","last_undegraded":"2024-04-26T12:13:25.556578+0000","last_fullsized":"2024-04-26T12:13:25.556578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470220+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:26.470220+0000","last_peered":"2024-04-26T12:13:26.470220+0000","last_clean":"2024-04-26T12:13:26.470220+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:26.470220+0000","last_undegraded":"2024-04-26T12:13:26.470220+0000","last_fullsized":"2024-04-26T12:13:26.470220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:31.826247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556329+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:25.556329+0000","last_peered":"2024-04-26T12:13:25.556329+0000","last_clean":"2024-04-26T12:13:25.556329+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:25.556329+0000","last_undegraded":"2024-04-26T12:13:25.556329+0000","last_fullsized":"2024-04-26T12:13:25.556329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:45.968725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471078+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:26.471078+0000","last_peered":"2024-04-26T12:13:26.471078+0000","last_clean":"2024-04-26T12:13:26.471078+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:26.471078+0000","last_undegraded":"2024-04-26T12:13:26.471078+0000","last_fullsized":"2024-04-26T12:13:26.471078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:01.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:52.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470700+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:26.470700+0000","last_peered":"2024-04-26T12:13:26.470700+0000","last_clean":"2024-04-26T12:13:26.470700+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:26.470700+0000","last_undegraded":"2024-04-26T12:13:26.470700+0000","last_fullsized":"2024-04-26T12:13:26.470700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:19.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":220,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469243+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:25.469243+0000","last_peered":"2024-04-26T12:13:25.469243+0000","last_clean":"2024-04-26T12:13:25.469243+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:25.469243+0000","last_undegraded":"2024-04-26T12:13:25.469243+0000","last_fullsized":"2024-04-26T12:13:25.469243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:35.149994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470231+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:26.470231+0000","last_peered":"2024-04-26T12:13:26.470231+0000","last_clean":"2024-04-26T12:13:26.470231+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:26.470231+0000","last_undegraded":"2024-04-26T12:13:26.470231+0000","last_fullsized":"2024-04-26T12:13:26.470231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:51.595471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556850+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:13:25.556850+0000","last_peered":"2024-04-26T12:13:25.556850+0000","last_clean":"2024-04-26T12:13:25.556850+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:25.556850+0000","last_undegraded":"2024-04-26T12:13:25.556850+0000","last_fullsized":"2024-04-26T12:13:25.556850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469686+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:25.469686+0000","last_peered":"2024-04-26T12:13:25.469686+0000","last_clean":"2024-04-26T12:13:25.469686+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:25.469686+0000","last_undegraded":"2024-04-26T12:13:25.469686+0000","last_fullsized":"2024-04-26T12:13:25.469686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.093761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555755+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:25.555755+0000","last_peered":"2024-04-26T12:13:25.555755+0000","last_clean":"2024-04-26T12:13:25.555755+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:25.555755+0000","last_undegraded":"2024-04-26T12:13:25.555755+0000","last_fullsized":"2024-04-26T12:13:25.555755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:22.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469453+0000","last_change":"2024-04-26T12:13:14.392269+0000","last_active":"2024-04-26T12:13:25.469453+0000","last_peered":"2024-04-26T12:13:25.469453+0000","last_clean":"2024-04-26T12:13:25.469453+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:25.469453+0000","last_undegraded":"2024-04-26T12:13:25.469453+0000","last_fullsized":"2024-04-26T12:13:25.469453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:55.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470399+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:26.470399+0000","last_peered":"2024-04-26T12:13:26.470399+0000","last_clean":"2024-04-26T12:13:26.470399+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:26.470399+0000","last_undegraded":"2024-04-26T12:13:26.470399+0000","last_fullsized":"2024-04-26T12:13:26.470399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470084+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:25.470084+0000","last_peered":"2024-04-26T12:13:25.470084+0000","last_clean":"2024-04-26T12:13:25.470084+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:25.470084+0000","last_undegraded":"2024-04-26T12:13:25.470084+0000","last_fullsized":"2024-04-26T12:13:25.470084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:24.319975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555821+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:25.555821+0000","last_peered":"2024-04-26T12:13:25.555821+0000","last_clean":"2024-04-26T12:13:25.555821+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:25.555821+0000","last_undegraded":"2024-04-26T12:13:25.555821+0000","last_fullsized":"2024-04-26T12:13:25.555821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469673+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:25.469673+0000","last_peered":"2024-04-26T12:13:25.469673+0000","last_clean":"2024-04-26T12:13:25.469673+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:25.469673+0000","last_undegraded":"2024-04-26T12:13:25.469673+0000","last_fullsized":"2024-04-26T12:13:25.469673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:03.736741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470868+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:26.470868+0000","last_peered":"2024-04-26T12:13:26.470868+0000","last_clean":"2024-04-26T12:13:26.470868+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:26.470868+0000","last_undegraded":"2024-04-26T12:13:26.470868+0000","last_fullsized":"2024-04-26T12:13:26.470868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556723+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:25.556723+0000","last_peered":"2024-04-26T12:13:25.556723+0000","last_clean":"2024-04-26T12:13:25.556723+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:25.556723+0000","last_undegraded":"2024-04-26T12:13:25.556723+0000","last_fullsized":"2024-04-26T12:13:25.556723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:57.924425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470966+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:26.470966+0000","last_peered":"2024-04-26T12:13:26.470966+0000","last_clean":"2024-04-26T12:13:26.470966+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:26.470966+0000","last_undegraded":"2024-04-26T12:13:26.470966+0000","last_fullsized":"2024-04-26T12:13:26.470966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470035+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:25.470035+0000","last_peered":"2024-04-26T12:13:25.470035+0000","last_clean":"2024-04-26T12:13:25.470035+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:25.470035+0000","last_undegraded":"2024-04-26T12:13:25.470035+0000","last_fullsized":"2024-04-26T12:13:25.470035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:17.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470195+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:25.470195+0000","last_peered":"2024-04-26T12:13:25.470195+0000","last_clean":"2024-04-26T12:13:25.470195+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:25.470195+0000","last_undegraded":"2024-04-26T12:13:25.470195+0000","last_fullsized":"2024-04-26T12:13:25.470195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:30.589803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556118+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:25.556118+0000","last_peered":"2024-04-26T12:13:25.556118+0000","last_clean":"2024-04-26T12:13:25.556118+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:25.556118+0000","last_undegraded":"2024-04-26T12:13:25.556118+0000","last_fullsized":"2024-04-26T12:13:25.556118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556109+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:25.556109+0000","last_peered":"2024-04-26T12:13:25.556109+0000","last_clean":"2024-04-26T12:13:25.556109+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:25.556109+0000","last_undegraded":"2024-04-26T12:13:25.556109+0000","last_fullsized":"2024-04-26T12:13:25.556109+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556413+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:25.556413+0000","last_peered":"2024-04-26T12:13:25.556413+0000","last_clean":"2024-04-26T12:13:25.556413+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:25.556413+0000","last_undegraded":"2024-04-26T12:13:25.556413+0000","last_fullsized":"2024-04-26T12:13:25.556413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469843+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:25.469843+0000","last_peered":"2024-04-26T12:13:25.469843+0000","last_clean":"2024-04-26T12:13:25.469843+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:25.469843+0000","last_undegraded":"2024-04-26T12:13:25.469843+0000","last_fullsized":"2024-04-26T12:13:25.469843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.214997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469946+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:25.469946+0000","last_peered":"2024-04-26T12:13:25.469946+0000","last_clean":"2024-04-26T12:13:25.469946+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:25.469946+0000","last_undegraded":"2024-04-26T12:13:25.469946+0000","last_fullsized":"2024-04-26T12:13:25.469946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.878980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":35,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469967+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:25.469967+0000","last_peered":"2024-04-26T12:13:25.469967+0000","last_clean":"2024-04-26T12:13:25.469967+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:25.469967+0000","last_undegraded":"2024-04-26T12:13:25.469967+0000","last_fullsized":"2024-04-26T12:13:25.469967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:33.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469576+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:25.469576+0000","last_peered":"2024-04-26T12:13:25.469576+0000","last_clean":"2024-04-26T12:13:25.469576+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:25.469576+0000","last_undegraded":"2024-04-26T12:13:25.469576+0000","last_fullsized":"2024-04-26T12:13:25.469576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:25.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471000+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:26.471000+0000","last_peered":"2024-04-26T12:13:26.471000+0000","last_clean":"2024-04-26T12:13:26.471000+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:26.471000+0000","last_undegraded":"2024-04-26T12:13:26.471000+0000","last_fullsized":"2024-04-26T12:13:26.471000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556129+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:25.556129+0000","last_peered":"2024-04-26T12:13:25.556129+0000","last_clean":"2024-04-26T12:13:25.556129+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:25.556129+0000","last_undegraded":"2024-04-26T12:13:25.556129+0000","last_fullsized":"2024-04-26T12:13:25.556129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.396440+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469405+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:25.469405+0000","last_peered":"2024-04-26T12:13:25.469405+0000","last_clean":"2024-04-26T12:13:25.469405+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:25.469405+0000","last_undegraded":"2024-04-26T12:13:25.469405+0000","last_fullsized":"2024-04-26T12:13:25.469405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:25.593914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469336+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:25.469336+0000","last_peered":"2024-04-26T12:13:25.469336+0000","last_clean":"2024-04-26T12:13:25.469336+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:25.469336+0000","last_undegraded":"2024-04-26T12:13:25.469336+0000","last_fullsized":"2024-04-26T12:13:25.469336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470322+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:13:26.470322+0000","last_peered":"2024-04-26T12:13:26.470322+0000","last_clean":"2024-04-26T12:13:26.470322+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:26.470322+0000","last_undegraded":"2024-04-26T12:13:26.470322+0000","last_fullsized":"2024-04-26T12:13:26.470322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556132+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:25.556132+0000","last_peered":"2024-04-26T12:13:25.556132+0000","last_clean":"2024-04-26T12:13:25.556132+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:25.556132+0000","last_undegraded":"2024-04-26T12:13:25.556132+0000","last_fullsized":"2024-04-26T12:13:25.556132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:48.553812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470936+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:26.470936+0000","last_peered":"2024-04-26T12:13:26.470936+0000","last_clean":"2024-04-26T12:13:26.470936+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:26.470936+0000","last_undegraded":"2024-04-26T12:13:26.470936+0000","last_fullsized":"2024-04-26T12:13:26.470936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556493+0000","last_change":"2024-04-26T12:13:14.394918+0000","last_active":"2024-04-26T12:13:25.556493+0000","last_peered":"2024-04-26T12:13:25.556493+0000","last_clean":"2024-04-26T12:13:25.556493+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:25.556493+0000","last_undegraded":"2024-04-26T12:13:25.556493+0000","last_fullsized":"2024-04-26T12:13:25.556493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002812,"statfs":{"total":96636764160,"available":96258879488,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.55900000000000005}]}]},{"osd":0,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289228,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082612,"statfs":{"total":96636764160,"available":96340594688,"internally_reserved":0,"allocated":1376256,"data_stored":889844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Apr 26 12:12:49 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.76900000000000002,"5min":2.214,"15min":2.214},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.42499999999999999},"min":{"1min":0.19500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.8440000000000001,"5min":2.294,"15min":2.294},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:31.203 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:13:31.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T12:13:31.630 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:13:31.639 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:13:31.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:32.007 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:32.009 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:32.020 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-26T12:13:30.922997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702384,"kb_used_data":3468,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413136,"statfs":{"total":289910292480,"available":289191051264,"internally_reserved":0,"allocated":3551232,"data_stored":2091482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556896+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:13:25.556896+0000","last_peered":"2024-04-26T12:13:25.556896+0000","last_clean":"2024-04-26T12:13:25.556896+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:25.556896+0000","last_undegraded":"2024-04-26T12:13:25.556896+0000","last_fullsized":"2024-04-26T12:13:25.556896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556602+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:25.556602+0000","last_peered":"2024-04-26T12:13:25.556602+0000","last_clean":"2024-04-26T12:13:25.556602+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:25.556602+0000","last_undegraded":"2024-04-26T12:13:25.556602+0000","last_fullsized":"2024-04-26T12:13:25.556602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470206+0000","last_change":"2024-04-26T12:13:14.393093+0000","last_active":"2024-04-26T12:13:25.470206+0000","last_peered":"2024-04-26T12:13:25.470206+0000","last_clean":"2024-04-26T12:13:25.470206+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:25.470206+0000","last_undegraded":"2024-04-26T12:13:25.470206+0000","last_fullsized":"2024-04-26T12:13:25.470206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:53.974372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469991+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:25.469991+0000","last_peered":"2024-04-26T12:13:25.469991+0000","last_clean":"2024-04-26T12:13:25.469991+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:25.469991+0000","last_undegraded":"2024-04-26T12:13:25.469991+0000","last_fullsized":"2024-04-26T12:13:25.469991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:57.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555963+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:25.555963+0000","last_peered":"2024-04-26T12:13:25.555963+0000","last_clean":"2024-04-26T12:13:25.555963+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:25.555963+0000","last_undegraded":"2024-04-26T12:13:25.555963+0000","last_fullsized":"2024-04-26T12:13:25.555963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469418+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:25.469418+0000","last_peered":"2024-04-26T12:13:25.469418+0000","last_clean":"2024-04-26T12:13:25.469418+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:25.469418+0000","last_undegraded":"2024-04-26T12:13:25.469418+0000","last_fullsized":"2024-04-26T12:13:25.469418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:21.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469383+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:25.469383+0000","last_peered":"2024-04-26T12:13:25.469383+0000","last_clean":"2024-04-26T12:13:25.469383+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:25.469383+0000","last_undegraded":"2024-04-26T12:13:25.469383+0000","last_fullsized":"2024-04-26T12:13:25.469383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:49.959427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469164+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:25.469164+0000","last_peered":"2024-04-26T12:13:25.469164+0000","last_clean":"2024-04-26T12:13:25.469164+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:25.469164+0000","last_undegraded":"2024-04-26T12:13:25.469164+0000","last_fullsized":"2024-04-26T12:13:25.469164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:03.771898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471091+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:26.471091+0000","last_peered":"2024-04-26T12:13:26.471091+0000","last_clean":"2024-04-26T12:13:26.471091+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:26.471091+0000","last_undegraded":"2024-04-26T12:13:26.471091+0000","last_fullsized":"2024-04-26T12:13:26.471091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556820+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:25.556820+0000","last_peered":"2024-04-26T12:13:25.556820+0000","last_clean":"2024-04-26T12:13:25.556820+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:25.556820+0000","last_undegraded":"2024-04-26T12:13:25.556820+0000","last_fullsized":"2024-04-26T12:13:25.556820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470312+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:25.470312+0000","last_peered":"2024-04-26T12:13:25.470312+0000","last_clean":"2024-04-26T12:13:25.470312+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:25.470312+0000","last_undegraded":"2024-04-26T12:13:25.470312+0000","last_fullsized":"2024-04-26T12:13:25.470312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:33.110932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556259+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:25.556259+0000","last_peered":"2024-04-26T12:13:25.556259+0000","last_clean":"2024-04-26T12:13:25.556259+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:25.556259+0000","last_undegraded":"2024-04-26T12:13:25.556259+0000","last_fullsized":"2024-04-26T12:13:25.556259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:29.958220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556152+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:13:25.556152+0000","last_peered":"2024-04-26T12:13:25.556152+0000","last_clean":"2024-04-26T12:13:25.556152+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:25.556152+0000","last_undegraded":"2024-04-26T12:13:25.556152+0000","last_fullsized":"2024-04-26T12:13:25.556152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469707+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:25.469707+0000","last_peered":"2024-04-26T12:13:25.469707+0000","last_clean":"2024-04-26T12:13:25.469707+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:25.469707+0000","last_undegraded":"2024-04-26T12:13:25.469707+0000","last_fullsized":"2024-04-26T12:13:25.469707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:45.547385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469637+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:25.469637+0000","last_peered":"2024-04-26T12:13:25.469637+0000","last_clean":"2024-04-26T12:13:25.469637+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:25.469637+0000","last_undegraded":"2024-04-26T12:13:25.469637+0000","last_fullsized":"2024-04-26T12:13:25.469637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469513+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:25.469513+0000","last_peered":"2024-04-26T12:13:25.469513+0000","last_clean":"2024-04-26T12:13:25.469513+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:25.469513+0000","last_undegraded":"2024-04-26T12:13:25.469513+0000","last_fullsized":"2024-04-26T12:13:25.469513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:19.229847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471104+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:26.471104+0000","last_peered":"2024-04-26T12:13:26.471104+0000","last_clean":"2024-04-26T12:13:26.471104+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:26.471104+0000","last_undegraded":"2024-04-26T12:13:26.471104+0000","last_fullsized":"2024-04-26T12:13:26.471104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556739+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:25.556739+0000","last_peered":"2024-04-26T12:13:25.556739+0000","last_clean":"2024-04-26T12:13:25.556739+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:25.556739+0000","last_undegraded":"2024-04-26T12:13:25.556739+0000","last_fullsized":"2024-04-26T12:13:25.556739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470865+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:26.470865+0000","last_peered":"2024-04-26T12:13:26.470865+0000","last_clean":"2024-04-26T12:13:26.470865+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:26.470865+0000","last_undegraded":"2024-04-26T12:13:26.470865+0000","last_fullsized":"2024-04-26T12:13:26.470865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470090+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:25.470090+0000","last_peered":"2024-04-26T12:13:25.470090+0000","last_clean":"2024-04-26T12:13:25.470090+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:25.470090+0000","last_undegraded":"2024-04-26T12:13:25.470090+0000","last_fullsized":"2024-04-26T12:13:25.470090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:07.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469579+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:25.469579+0000","last_peered":"2024-04-26T12:13:25.469579+0000","last_clean":"2024-04-26T12:13:25.469579+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:25.469579+0000","last_undegraded":"2024-04-26T12:13:25.469579+0000","last_fullsized":"2024-04-26T12:13:25.469579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:49.995173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556027+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:25.556027+0000","last_peered":"2024-04-26T12:13:25.556027+0000","last_clean":"2024-04-26T12:13:25.556027+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:25.556027+0000","last_undegraded":"2024-04-26T12:13:25.556027+0000","last_fullsized":"2024-04-26T12:13:25.556027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:21.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470536+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:26.470536+0000","last_peered":"2024-04-26T12:13:26.470536+0000","last_clean":"2024-04-26T12:13:26.470536+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:26.470536+0000","last_undegraded":"2024-04-26T12:13:26.470536+0000","last_fullsized":"2024-04-26T12:13:26.470536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556824+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:25.556824+0000","last_peered":"2024-04-26T12:13:25.556824+0000","last_clean":"2024-04-26T12:13:25.556824+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:25.556824+0000","last_undegraded":"2024-04-26T12:13:25.556824+0000","last_fullsized":"2024-04-26T12:13:25.556824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:04.826156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470956+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:26.470956+0000","last_peered":"2024-04-26T12:13:26.470956+0000","last_clean":"2024-04-26T12:13:26.470956+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:26.470956+0000","last_undegraded":"2024-04-26T12:13:26.470956+0000","last_fullsized":"2024-04-26T12:13:26.470956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:32.586178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470373+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:25.470373+0000","last_peered":"2024-04-26T12:13:25.470373+0000","last_clean":"2024-04-26T12:13:25.470373+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:25.470373+0000","last_undegraded":"2024-04-26T12:13:25.470373+0000","last_fullsized":"2024-04-26T12:13:25.470373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:43.755438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556628+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:25.556628+0000","last_peered":"2024-04-26T12:13:25.556628+0000","last_clean":"2024-04-26T12:13:25.556628+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:25.556628+0000","last_undegraded":"2024-04-26T12:13:25.556628+0000","last_fullsized":"2024-04-26T12:13:25.556628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470431+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:26.470431+0000","last_peered":"2024-04-26T12:13:26.470431+0000","last_clean":"2024-04-26T12:13:26.470431+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:26.470431+0000","last_undegraded":"2024-04-26T12:13:26.470431+0000","last_fullsized":"2024-04-26T12:13:26.470431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:33.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471084+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:26.471084+0000","last_peered":"2024-04-26T12:13:26.471084+0000","last_clean":"2024-04-26T12:13:26.471084+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:26.471084+0000","last_undegraded":"2024-04-26T12:13:26.471084+0000","last_fullsized":"2024-04-26T12:13:26.471084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.984438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470294+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:26.470294+0000","last_peered":"2024-04-26T12:13:26.470294+0000","last_clean":"2024-04-26T12:13:26.470294+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:26.470294+0000","last_undegraded":"2024-04-26T12:13:26.470294+0000","last_fullsized":"2024-04-26T12:13:26.470294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556818+0000","last_change":"2024-04-26T12:13:14.393885+0000","last_active":"2024-04-26T12:13:25.556818+0000","last_peered":"2024-04-26T12:13:25.556818+0000","last_clean":"2024-04-26T12:13:25.556818+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:25.556818+0000","last_undegraded":"2024-04-26T12:13:25.556818+0000","last_fullsized":"2024-04-26T12:13:25.556818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:37.146713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471245+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:26.471245+0000","last_peered":"2024-04-26T12:13:26.471245+0000","last_clean":"2024-04-26T12:13:26.471245+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:26.471245+0000","last_undegraded":"2024-04-26T12:13:26.471245+0000","last_fullsized":"2024-04-26T12:13:26.471245+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:07.033491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470178+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:13:26.470178+0000","last_peered":"2024-04-26T12:13:26.470178+0000","last_clean":"2024-04-26T12:13:26.470178+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:26.470178+0000","last_undegraded":"2024-04-26T12:13:26.470178+0000","last_fullsized":"2024-04-26T12:13:26.470178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470146+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:25.470146+0000","last_peered":"2024-04-26T12:13:25.470146+0000","last_clean":"2024-04-26T12:13:25.470146+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:25.470146+0000","last_undegraded":"2024-04-26T12:13:25.470146+0000","last_fullsized":"2024-04-26T12:13:25.470146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:08.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470437+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:26.470437+0000","last_peered":"2024-04-26T12:13:26.470437+0000","last_clean":"2024-04-26T12:13:26.470437+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:26.470437+0000","last_undegraded":"2024-04-26T12:13:26.470437+0000","last_fullsized":"2024-04-26T12:13:26.470437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:18.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556528+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:25.556528+0000","last_peered":"2024-04-26T12:13:25.556528+0000","last_clean":"2024-04-26T12:13:25.556528+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:25.556528+0000","last_undegraded":"2024-04-26T12:13:25.556528+0000","last_fullsized":"2024-04-26T12:13:25.556528+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:28.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470469+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:13:26.470469+0000","last_peered":"2024-04-26T12:13:26.470469+0000","last_clean":"2024-04-26T12:13:26.470469+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:26.470469+0000","last_undegraded":"2024-04-26T12:13:26.470469+0000","last_fullsized":"2024-04-26T12:13:26.470469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":31,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470033+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:25.470033+0000","last_peered":"2024-04-26T12:13:25.470033+0000","last_clean":"2024-04-26T12:13:25.470033+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:25.470033+0000","last_undegraded":"2024-04-26T12:13:25.470033+0000","last_fullsized":"2024-04-26T12:13:25.470033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:36.499448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470004+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:25.470004+0000","last_peered":"2024-04-26T12:13:25.470004+0000","last_clean":"2024-04-26T12:13:25.470004+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:25.470004+0000","last_undegraded":"2024-04-26T12:13:25.470004+0000","last_fullsized":"2024-04-26T12:13:25.470004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:06.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469561+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:25.469561+0000","last_peered":"2024-04-26T12:13:25.469561+0000","last_clean":"2024-04-26T12:13:25.469561+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:25.469561+0000","last_undegraded":"2024-04-26T12:13:25.469561+0000","last_fullsized":"2024-04-26T12:13:25.469561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.636439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556317+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:13:25.556317+0000","last_peered":"2024-04-26T12:13:25.556317+0000","last_clean":"2024-04-26T12:13:25.556317+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:25.556317+0000","last_undegraded":"2024-04-26T12:13:25.556317+0000","last_fullsized":"2024-04-26T12:13:25.556317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470356+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:26.470356+0000","last_peered":"2024-04-26T12:13:26.470356+0000","last_clean":"2024-04-26T12:13:26.470356+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:26.470356+0000","last_undegraded":"2024-04-26T12:13:26.470356+0000","last_fullsized":"2024-04-26T12:13:26.470356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:34.040588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556733+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:13:25.556733+0000","last_peered":"2024-04-26T12:13:25.556733+0000","last_clean":"2024-04-26T12:13:25.556733+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:25.556733+0000","last_undegraded":"2024-04-26T12:13:25.556733+0000","last_fullsized":"2024-04-26T12:13:25.556733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555973+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:25.555973+0000","last_peered":"2024-04-26T12:13:25.555973+0000","last_clean":"2024-04-26T12:13:25.555973+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:25.555973+0000","last_undegraded":"2024-04-26T12:13:25.555973+0000","last_fullsized":"2024-04-26T12:13:25.555973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:23.129074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471225+0000","last_change":"2024-04-26T12:13:14.392569+0000","last_active":"2024-04-26T12:13:26.471225+0000","last_peered":"2024-04-26T12:13:26.471225+0000","last_clean":"2024-04-26T12:13:26.471225+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:26.471225+0000","last_undegraded":"2024-04-26T12:13:26.471225+0000","last_fullsized":"2024-04-26T12:13:26.471225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":30,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469289+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:25.469289+0000","last_peered":"2024-04-26T12:13:25.469289+0000","last_clean":"2024-04-26T12:13:25.469289+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:25.469289+0000","last_undegraded":"2024-04-26T12:13:25.469289+0000","last_fullsized":"2024-04-26T12:13:25.469289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:07.348907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471306+0000","last_change":"2024-04-26T12:13:14.396669+0000","last_active":"2024-04-26T12:13:26.471306+0000","last_peered":"2024-04-26T12:13:26.471306+0000","last_clean":"2024-04-26T12:13:26.471306+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:26.471306+0000","last_undegraded":"2024-04-26T12:13:26.471306+0000","last_fullsized":"2024-04-26T12:13:26.471306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470330+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:25.470330+0000","last_peered":"2024-04-26T12:13:25.470330+0000","last_clean":"2024-04-26T12:13:25.470330+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:25.470330+0000","last_undegraded":"2024-04-26T12:13:25.470330+0000","last_fullsized":"2024-04-26T12:13:25.470330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555625+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:25.555625+0000","last_peered":"2024-04-26T12:13:25.555625+0000","last_clean":"2024-04-26T12:13:25.555625+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:25.555625+0000","last_undegraded":"2024-04-26T12:13:25.555625+0000","last_fullsized":"2024-04-26T12:13:25.555625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:44.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":81,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556598+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:25.556598+0000","last_peered":"2024-04-26T12:13:25.556598+0000","last_clean":"2024-04-26T12:13:25.556598+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:25.556598+0000","last_undegraded":"2024-04-26T12:13:25.556598+0000","last_fullsized":"2024-04-26T12:13:25.556598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.186277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556093+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:25.556093+0000","last_peered":"2024-04-26T12:13:25.556093+0000","last_clean":"2024-04-26T12:13:25.556093+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:25.556093+0000","last_undegraded":"2024-04-26T12:13:25.556093+0000","last_fullsized":"2024-04-26T12:13:25.556093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469954+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:25.469954+0000","last_peered":"2024-04-26T12:13:25.469954+0000","last_clean":"2024-04-26T12:13:25.469954+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:25.469954+0000","last_undegraded":"2024-04-26T12:13:25.469954+0000","last_fullsized":"2024-04-26T12:13:25.469954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:29.651436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469598+0000","last_change":"2024-04-26T12:13:14.392806+0000","last_active":"2024-04-26T12:13:25.469598+0000","last_peered":"2024-04-26T12:13:25.469598+0000","last_clean":"2024-04-26T12:13:25.469598+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:25.469598+0000","last_undegraded":"2024-04-26T12:13:25.469598+0000","last_fullsized":"2024-04-26T12:13:25.469598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:27.472246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470144+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:25.470144+0000","last_peered":"2024-04-26T12:13:25.470144+0000","last_clean":"2024-04-26T12:13:25.470144+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:25.470144+0000","last_undegraded":"2024-04-26T12:13:25.470144+0000","last_fullsized":"2024-04-26T12:13:25.470144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:43.465677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470638+0000","last_change":"2024-04-26T12:13:14.396914+0000","last_active":"2024-04-26T12:13:26.470638+0000","last_peered":"2024-04-26T12:13:26.470638+0000","last_clean":"2024-04-26T12:13:26.470638+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:26.470638+0000","last_undegraded":"2024-04-26T12:13:26.470638+0000","last_fullsized":"2024-04-26T12:13:26.470638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:33.086082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470602+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:26.470602+0000","last_peered":"2024-04-26T12:13:26.470602+0000","last_clean":"2024-04-26T12:13:26.470602+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:26.470602+0000","last_undegraded":"2024-04-26T12:13:26.470602+0000","last_fullsized":"2024-04-26T12:13:26.470602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:42.180071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469889+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:25.469889+0000","last_peered":"2024-04-26T12:13:25.469889+0000","last_clean":"2024-04-26T12:13:25.469889+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:25.469889+0000","last_undegraded":"2024-04-26T12:13:25.469889+0000","last_fullsized":"2024-04-26T12:13:25.469889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:16.727025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469510+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:25.469510+0000","last_peered":"2024-04-26T12:13:25.469510+0000","last_clean":"2024-04-26T12:13:25.469510+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:25.469510+0000","last_undegraded":"2024-04-26T12:13:25.469510+0000","last_fullsized":"2024-04-26T12:13:25.469510+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:39.928988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470349+0000","last_change":"2024-04-26T12:13:14.394506+0000","last_active":"2024-04-26T12:13:25.470349+0000","last_peered":"2024-04-26T12:13:25.470349+0000","last_clean":"2024-04-26T12:13:25.470349+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:25.470349+0000","last_undegraded":"2024-04-26T12:13:25.470349+0000","last_fullsized":"2024-04-26T12:13:25.470349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:14.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555820+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:25.555820+0000","last_peered":"2024-04-26T12:13:25.555820+0000","last_clean":"2024-04-26T12:13:25.555820+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:25.555820+0000","last_undegraded":"2024-04-26T12:13:25.555820+0000","last_fullsized":"2024-04-26T12:13:25.555820+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:24.717066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470241+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:25.470241+0000","last_peered":"2024-04-26T12:13:25.470241+0000","last_clean":"2024-04-26T12:13:25.470241+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:25.470241+0000","last_undegraded":"2024-04-26T12:13:25.470241+0000","last_fullsized":"2024-04-26T12:13:25.470241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:48.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":66,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555783+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:25.555783+0000","last_peered":"2024-04-26T12:13:25.555783+0000","last_clean":"2024-04-26T12:13:25.555783+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:25.555783+0000","last_undegraded":"2024-04-26T12:13:25.555783+0000","last_fullsized":"2024-04-26T12:13:25.555783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471174+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:26.471174+0000","last_peered":"2024-04-26T12:13:26.471174+0000","last_clean":"2024-04-26T12:13:26.471174+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:26.471174+0000","last_undegraded":"2024-04-26T12:13:26.471174+0000","last_fullsized":"2024-04-26T12:13:26.471174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471166+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:26.471166+0000","last_peered":"2024-04-26T12:13:26.471166+0000","last_clean":"2024-04-26T12:13:26.471166+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:26.471166+0000","last_undegraded":"2024-04-26T12:13:26.471166+0000","last_fullsized":"2024-04-26T12:13:26.471166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556578+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:25.556578+0000","last_peered":"2024-04-26T12:13:25.556578+0000","last_clean":"2024-04-26T12:13:25.556578+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:25.556578+0000","last_undegraded":"2024-04-26T12:13:25.556578+0000","last_fullsized":"2024-04-26T12:13:25.556578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470220+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:26.470220+0000","last_peered":"2024-04-26T12:13:26.470220+0000","last_clean":"2024-04-26T12:13:26.470220+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:26.470220+0000","last_undegraded":"2024-04-26T12:13:26.470220+0000","last_fullsized":"2024-04-26T12:13:26.470220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:31.826247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556329+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:25.556329+0000","last_peered":"2024-04-26T12:13:25.556329+0000","last_clean":"2024-04-26T12:13:25.556329+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:25.556329+0000","last_undegraded":"2024-04-26T12:13:25.556329+0000","last_fullsized":"2024-04-26T12:13:25.556329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:45.968725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471078+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:26.471078+0000","last_peered":"2024-04-26T12:13:26.471078+0000","last_clean":"2024-04-26T12:13:26.471078+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:26.471078+0000","last_undegraded":"2024-04-26T12:13:26.471078+0000","last_fullsized":"2024-04-26T12:13:26.471078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:01.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:52.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470700+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:26.470700+0000","last_peered":"2024-04-26T12:13:26.470700+0000","last_clean":"2024-04-26T12:13:26.470700+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:26.470700+0000","last_undegraded":"2024-04-26T12:13:26.470700+0000","last_fullsized":"2024-04-26T12:13:26.470700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:19.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":220,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469243+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:25.469243+0000","last_peered":"2024-04-26T12:13:25.469243+0000","last_clean":"2024-04-26T12:13:25.469243+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:25.469243+0000","last_undegraded":"2024-04-26T12:13:25.469243+0000","last_fullsized":"2024-04-26T12:13:25.469243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:35.149994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470231+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:26.470231+0000","last_peered":"2024-04-26T12:13:26.470231+0000","last_clean":"2024-04-26T12:13:26.470231+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:26.470231+0000","last_undegraded":"2024-04-26T12:13:26.470231+0000","last_fullsized":"2024-04-26T12:13:26.470231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:51.595471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556850+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:13:25.556850+0000","last_peered":"2024-04-26T12:13:25.556850+0000","last_clean":"2024-04-26T12:13:25.556850+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:25.556850+0000","last_undegraded":"2024-04-26T12:13:25.556850+0000","last_fullsized":"2024-04-26T12:13:25.556850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469686+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:25.469686+0000","last_peered":"2024-04-26T12:13:25.469686+0000","last_clean":"2024-04-26T12:13:25.469686+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:25.469686+0000","last_undegraded":"2024-04-26T12:13:25.469686+0000","last_fullsized":"2024-04-26T12:13:25.469686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.093761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555755+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:25.555755+0000","last_peered":"2024-04-26T12:13:25.555755+0000","last_clean":"2024-04-26T12:13:25.555755+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:25.555755+0000","last_undegraded":"2024-04-26T12:13:25.555755+0000","last_fullsized":"2024-04-26T12:13:25.555755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:22.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469453+0000","last_change":"2024-04-26T12:13:14.392269+0000","last_active":"2024-04-26T12:13:25.469453+0000","last_peered":"2024-04-26T12:13:25.469453+0000","last_clean":"2024-04-26T12:13:25.469453+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:25.469453+0000","last_undegraded":"2024-04-26T12:13:25.469453+0000","last_fullsized":"2024-04-26T12:13:25.469453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:55.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470399+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:26.470399+0000","last_peered":"2024-04-26T12:13:26.470399+0000","last_clean":"2024-04-26T12:13:26.470399+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:26.470399+0000","last_undegraded":"2024-04-26T12:13:26.470399+0000","last_fullsized":"2024-04-26T12:13:26.470399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470084+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:25.470084+0000","last_peered":"2024-04-26T12:13:25.470084+0000","last_clean":"2024-04-26T12:13:25.470084+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:25.470084+0000","last_undegraded":"2024-04-26T12:13:25.470084+0000","last_fullsized":"2024-04-26T12:13:25.470084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:24.319975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555821+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:25.555821+0000","last_peered":"2024-04-26T12:13:25.555821+0000","last_clean":"2024-04-26T12:13:25.555821+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:25.555821+0000","last_undegraded":"2024-04-26T12:13:25.555821+0000","last_fullsized":"2024-04-26T12:13:25.555821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469673+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:25.469673+0000","last_peered":"2024-04-26T12:13:25.469673+0000","last_clean":"2024-04-26T12:13:25.469673+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:25.469673+0000","last_undegraded":"2024-04-26T12:13:25.469673+0000","last_fullsized":"2024-04-26T12:13:25.469673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:03.736741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470868+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:26.470868+0000","last_peered":"2024-04-26T12:13:26.470868+0000","last_clean":"2024-04-26T12:13:26.470868+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:26.470868+0000","last_undegraded":"2024-04-26T12:13:26.470868+0000","last_fullsized":"2024-04-26T12:13:26.470868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556723+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:25.556723+0000","last_peered":"2024-04-26T12:13:25.556723+0000","last_clean":"2024-04-26T12:13:25.556723+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:25.556723+0000","last_undegraded":"2024-04-26T12:13:25.556723+0000","last_fullsized":"2024-04-26T12:13:25.556723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:57.924425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470966+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:26.470966+0000","last_peered":"2024-04-26T12:13:26.470966+0000","last_clean":"2024-04-26T12:13:26.470966+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:26.470966+0000","last_undegraded":"2024-04-26T12:13:26.470966+0000","last_fullsized":"2024-04-26T12:13:26.470966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470035+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:25.470035+0000","last_peered":"2024-04-26T12:13:25.470035+0000","last_clean":"2024-04-26T12:13:25.470035+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:25.470035+0000","last_undegraded":"2024-04-26T12:13:25.470035+0000","last_fullsized":"2024-04-26T12:13:25.470035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:17.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470195+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:25.470195+0000","last_peered":"2024-04-26T12:13:25.470195+0000","last_clean":"2024-04-26T12:13:25.470195+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:25.470195+0000","last_undegraded":"2024-04-26T12:13:25.470195+0000","last_fullsized":"2024-04-26T12:13:25.470195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:30.589803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556118+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:25.556118+0000","last_peered":"2024-04-26T12:13:25.556118+0000","last_clean":"2024-04-26T12:13:25.556118+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:25.556118+0000","last_undegraded":"2024-04-26T12:13:25.556118+0000","last_fullsized":"2024-04-26T12:13:25.556118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556109+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:25.556109+0000","last_peered":"2024-04-26T12:13:25.556109+0000","last_clean":"2024-04-26T12:13:25.556109+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:25.556109+0000","last_undegraded":"2024-04-26T12:13:25.556109+0000","last_fullsized":"2024-04-26T12:13:25.556109+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556413+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:25.556413+0000","last_peered":"2024-04-26T12:13:25.556413+0000","last_clean":"2024-04-26T12:13:25.556413+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:25.556413+0000","last_undegraded":"2024-04-26T12:13:25.556413+0000","last_fullsized":"2024-04-26T12:13:25.556413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469843+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:25.469843+0000","last_peered":"2024-04-26T12:13:25.469843+0000","last_clean":"2024-04-26T12:13:25.469843+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:25.469843+0000","last_undegraded":"2024-04-26T12:13:25.469843+0000","last_fullsized":"2024-04-26T12:13:25.469843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.214997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469946+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:25.469946+0000","last_peered":"2024-04-26T12:13:25.469946+0000","last_clean":"2024-04-26T12:13:25.469946+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:25.469946+0000","last_undegraded":"2024-04-26T12:13:25.469946+0000","last_fullsized":"2024-04-26T12:13:25.469946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.878980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":35,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469967+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:25.469967+0000","last_peered":"2024-04-26T12:13:25.469967+0000","last_clean":"2024-04-26T12:13:25.469967+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:25.469967+0000","last_undegraded":"2024-04-26T12:13:25.469967+0000","last_fullsized":"2024-04-26T12:13:25.469967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:33.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469576+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:25.469576+0000","last_peered":"2024-04-26T12:13:25.469576+0000","last_clean":"2024-04-26T12:13:25.469576+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:25.469576+0000","last_undegraded":"2024-04-26T12:13:25.469576+0000","last_fullsized":"2024-04-26T12:13:25.469576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:25.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471000+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:26.471000+0000","last_peered":"2024-04-26T12:13:26.471000+0000","last_clean":"2024-04-26T12:13:26.471000+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:26.471000+0000","last_undegraded":"2024-04-26T12:13:26.471000+0000","last_fullsized":"2024-04-26T12:13:26.471000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556129+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:25.556129+0000","last_peered":"2024-04-26T12:13:25.556129+0000","last_clean":"2024-04-26T12:13:25.556129+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:25.556129+0000","last_undegraded":"2024-04-26T12:13:25.556129+0000","last_fullsized":"2024-04-26T12:13:25.556129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.396440+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469405+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:25.469405+0000","last_peered":"2024-04-26T12:13:25.469405+0000","last_clean":"2024-04-26T12:13:25.469405+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:25.469405+0000","last_undegraded":"2024-04-26T12:13:25.469405+0000","last_fullsized":"2024-04-26T12:13:25.469405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:25.593914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469336+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:25.469336+0000","last_peered":"2024-04-26T12:13:25.469336+0000","last_clean":"2024-04-26T12:13:25.469336+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:25.469336+0000","last_undegraded":"2024-04-26T12:13:25.469336+0000","last_fullsized":"2024-04-26T12:13:25.469336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470322+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:13:26.470322+0000","last_peered":"2024-04-26T12:13:26.470322+0000","last_clean":"2024-04-26T12:13:26.470322+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:26.470322+0000","last_undegraded":"2024-04-26T12:13:26.470322+0000","last_fullsized":"2024-04-26T12:13:26.470322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556132+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:25.556132+0000","last_peered":"2024-04-26T12:13:25.556132+0000","last_clean":"2024-04-26T12:13:25.556132+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:25.556132+0000","last_undegraded":"2024-04-26T12:13:25.556132+0000","last_fullsized":"2024-04-26T12:13:25.556132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:48.553812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470936+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:26.470936+0000","last_peered":"2024-04-26T12:13:26.470936+0000","last_clean":"2024-04-26T12:13:26.470936+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:26.470936+0000","last_undegraded":"2024-04-26T12:13:26.470936+0000","last_fullsized":"2024-04-26T12:13:26.470936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556493+0000","last_change":"2024-04-26T12:13:14.394918+0000","last_active":"2024-04-26T12:13:25.556493+0000","last_peered":"2024-04-26T12:13:25.556493+0000","last_clean":"2024-04-26T12:13:25.556493+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:25.556493+0000","last_undegraded":"2024-04-26T12:13:25.556493+0000","last_fullsized":"2024-04-26T12:13:25.556493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002812,"statfs":{"total":96636764160,"available":96258879488,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.55900000000000005}]}]},{"osd":0,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289228,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082612,"statfs":{"total":96636764160,"available":96340594688,"internally_reserved":0,"allocated":1376256,"data_stored":889844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Apr 26 12:12:49 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.76900000000000002,"5min":2.214,"15min":2.214},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.42499999999999999},"min":{"1min":0.19500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.8440000000000001,"5min":2.294,"15min":2.294},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:32.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:32.431 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:32.444 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-26T12:13:30.922997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702384,"kb_used_data":3468,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413136,"statfs":{"total":289910292480,"available":289191051264,"internally_reserved":0,"allocated":3551232,"data_stored":2091482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556896+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:13:25.556896+0000","last_peered":"2024-04-26T12:13:25.556896+0000","last_clean":"2024-04-26T12:13:25.556896+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:25.556896+0000","last_undegraded":"2024-04-26T12:13:25.556896+0000","last_fullsized":"2024-04-26T12:13:25.556896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556602+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:25.556602+0000","last_peered":"2024-04-26T12:13:25.556602+0000","last_clean":"2024-04-26T12:13:25.556602+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:25.556602+0000","last_undegraded":"2024-04-26T12:13:25.556602+0000","last_fullsized":"2024-04-26T12:13:25.556602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470206+0000","last_change":"2024-04-26T12:13:14.393093+0000","last_active":"2024-04-26T12:13:25.470206+0000","last_peered":"2024-04-26T12:13:25.470206+0000","last_clean":"2024-04-26T12:13:25.470206+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:25.470206+0000","last_undegraded":"2024-04-26T12:13:25.470206+0000","last_fullsized":"2024-04-26T12:13:25.470206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:53.974372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469991+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:25.469991+0000","last_peered":"2024-04-26T12:13:25.469991+0000","last_clean":"2024-04-26T12:13:25.469991+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:25.469991+0000","last_undegraded":"2024-04-26T12:13:25.469991+0000","last_fullsized":"2024-04-26T12:13:25.469991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:57.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555963+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:25.555963+0000","last_peered":"2024-04-26T12:13:25.555963+0000","last_clean":"2024-04-26T12:13:25.555963+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:25.555963+0000","last_undegraded":"2024-04-26T12:13:25.555963+0000","last_fullsized":"2024-04-26T12:13:25.555963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469418+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:25.469418+0000","last_peered":"2024-04-26T12:13:25.469418+0000","last_clean":"2024-04-26T12:13:25.469418+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:25.469418+0000","last_undegraded":"2024-04-26T12:13:25.469418+0000","last_fullsized":"2024-04-26T12:13:25.469418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:21.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469383+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:25.469383+0000","last_peered":"2024-04-26T12:13:25.469383+0000","last_clean":"2024-04-26T12:13:25.469383+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:25.469383+0000","last_undegraded":"2024-04-26T12:13:25.469383+0000","last_fullsized":"2024-04-26T12:13:25.469383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:49.959427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469164+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:25.469164+0000","last_peered":"2024-04-26T12:13:25.469164+0000","last_clean":"2024-04-26T12:13:25.469164+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:25.469164+0000","last_undegraded":"2024-04-26T12:13:25.469164+0000","last_fullsized":"2024-04-26T12:13:25.469164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:03.771898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471091+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:26.471091+0000","last_peered":"2024-04-26T12:13:26.471091+0000","last_clean":"2024-04-26T12:13:26.471091+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:26.471091+0000","last_undegraded":"2024-04-26T12:13:26.471091+0000","last_fullsized":"2024-04-26T12:13:26.471091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556820+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:25.556820+0000","last_peered":"2024-04-26T12:13:25.556820+0000","last_clean":"2024-04-26T12:13:25.556820+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:25.556820+0000","last_undegraded":"2024-04-26T12:13:25.556820+0000","last_fullsized":"2024-04-26T12:13:25.556820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470312+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:25.470312+0000","last_peered":"2024-04-26T12:13:25.470312+0000","last_clean":"2024-04-26T12:13:25.470312+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:25.470312+0000","last_undegraded":"2024-04-26T12:13:25.470312+0000","last_fullsized":"2024-04-26T12:13:25.470312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:33.110932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556259+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:25.556259+0000","last_peered":"2024-04-26T12:13:25.556259+0000","last_clean":"2024-04-26T12:13:25.556259+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:25.556259+0000","last_undegraded":"2024-04-26T12:13:25.556259+0000","last_fullsized":"2024-04-26T12:13:25.556259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:29.958220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556152+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:13:25.556152+0000","last_peered":"2024-04-26T12:13:25.556152+0000","last_clean":"2024-04-26T12:13:25.556152+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:25.556152+0000","last_undegraded":"2024-04-26T12:13:25.556152+0000","last_fullsized":"2024-04-26T12:13:25.556152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469707+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:25.469707+0000","last_peered":"2024-04-26T12:13:25.469707+0000","last_clean":"2024-04-26T12:13:25.469707+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:25.469707+0000","last_undegraded":"2024-04-26T12:13:25.469707+0000","last_fullsized":"2024-04-26T12:13:25.469707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:45.547385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469637+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:25.469637+0000","last_peered":"2024-04-26T12:13:25.469637+0000","last_clean":"2024-04-26T12:13:25.469637+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:25.469637+0000","last_undegraded":"2024-04-26T12:13:25.469637+0000","last_fullsized":"2024-04-26T12:13:25.469637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469513+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:25.469513+0000","last_peered":"2024-04-26T12:13:25.469513+0000","last_clean":"2024-04-26T12:13:25.469513+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:25.469513+0000","last_undegraded":"2024-04-26T12:13:25.469513+0000","last_fullsized":"2024-04-26T12:13:25.469513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:19.229847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471104+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:26.471104+0000","last_peered":"2024-04-26T12:13:26.471104+0000","last_clean":"2024-04-26T12:13:26.471104+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:26.471104+0000","last_undegraded":"2024-04-26T12:13:26.471104+0000","last_fullsized":"2024-04-26T12:13:26.471104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556739+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:25.556739+0000","last_peered":"2024-04-26T12:13:25.556739+0000","last_clean":"2024-04-26T12:13:25.556739+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:25.556739+0000","last_undegraded":"2024-04-26T12:13:25.556739+0000","last_fullsized":"2024-04-26T12:13:25.556739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470865+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:26.470865+0000","last_peered":"2024-04-26T12:13:26.470865+0000","last_clean":"2024-04-26T12:13:26.470865+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:26.470865+0000","last_undegraded":"2024-04-26T12:13:26.470865+0000","last_fullsized":"2024-04-26T12:13:26.470865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470090+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:25.470090+0000","last_peered":"2024-04-26T12:13:25.470090+0000","last_clean":"2024-04-26T12:13:25.470090+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:25.470090+0000","last_undegraded":"2024-04-26T12:13:25.470090+0000","last_fullsized":"2024-04-26T12:13:25.470090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:07.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469579+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:25.469579+0000","last_peered":"2024-04-26T12:13:25.469579+0000","last_clean":"2024-04-26T12:13:25.469579+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:25.469579+0000","last_undegraded":"2024-04-26T12:13:25.469579+0000","last_fullsized":"2024-04-26T12:13:25.469579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:49.995173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556027+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:25.556027+0000","last_peered":"2024-04-26T12:13:25.556027+0000","last_clean":"2024-04-26T12:13:25.556027+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:25.556027+0000","last_undegraded":"2024-04-26T12:13:25.556027+0000","last_fullsized":"2024-04-26T12:13:25.556027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:21.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470536+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:26.470536+0000","last_peered":"2024-04-26T12:13:26.470536+0000","last_clean":"2024-04-26T12:13:26.470536+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:26.470536+0000","last_undegraded":"2024-04-26T12:13:26.470536+0000","last_fullsized":"2024-04-26T12:13:26.470536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556824+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:25.556824+0000","last_peered":"2024-04-26T12:13:25.556824+0000","last_clean":"2024-04-26T12:13:25.556824+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:25.556824+0000","last_undegraded":"2024-04-26T12:13:25.556824+0000","last_fullsized":"2024-04-26T12:13:25.556824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:04.826156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470956+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:26.470956+0000","last_peered":"2024-04-26T12:13:26.470956+0000","last_clean":"2024-04-26T12:13:26.470956+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:26.470956+0000","last_undegraded":"2024-04-26T12:13:26.470956+0000","last_fullsized":"2024-04-26T12:13:26.470956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:32.586178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470373+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:25.470373+0000","last_peered":"2024-04-26T12:13:25.470373+0000","last_clean":"2024-04-26T12:13:25.470373+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:25.470373+0000","last_undegraded":"2024-04-26T12:13:25.470373+0000","last_fullsized":"2024-04-26T12:13:25.470373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:43.755438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556628+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:25.556628+0000","last_peered":"2024-04-26T12:13:25.556628+0000","last_clean":"2024-04-26T12:13:25.556628+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:25.556628+0000","last_undegraded":"2024-04-26T12:13:25.556628+0000","last_fullsized":"2024-04-26T12:13:25.556628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470431+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:26.470431+0000","last_peered":"2024-04-26T12:13:26.470431+0000","last_clean":"2024-04-26T12:13:26.470431+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:26.470431+0000","last_undegraded":"2024-04-26T12:13:26.470431+0000","last_fullsized":"2024-04-26T12:13:26.470431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:33.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471084+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:26.471084+0000","last_peered":"2024-04-26T12:13:26.471084+0000","last_clean":"2024-04-26T12:13:26.471084+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:26.471084+0000","last_undegraded":"2024-04-26T12:13:26.471084+0000","last_fullsized":"2024-04-26T12:13:26.471084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.984438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470294+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:26.470294+0000","last_peered":"2024-04-26T12:13:26.470294+0000","last_clean":"2024-04-26T12:13:26.470294+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:26.470294+0000","last_undegraded":"2024-04-26T12:13:26.470294+0000","last_fullsized":"2024-04-26T12:13:26.470294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556818+0000","last_change":"2024-04-26T12:13:14.393885+0000","last_active":"2024-04-26T12:13:25.556818+0000","last_peered":"2024-04-26T12:13:25.556818+0000","last_clean":"2024-04-26T12:13:25.556818+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:25.556818+0000","last_undegraded":"2024-04-26T12:13:25.556818+0000","last_fullsized":"2024-04-26T12:13:25.556818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:37.146713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471245+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:26.471245+0000","last_peered":"2024-04-26T12:13:26.471245+0000","last_clean":"2024-04-26T12:13:26.471245+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:26.471245+0000","last_undegraded":"2024-04-26T12:13:26.471245+0000","last_fullsized":"2024-04-26T12:13:26.471245+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:07.033491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470178+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:13:26.470178+0000","last_peered":"2024-04-26T12:13:26.470178+0000","last_clean":"2024-04-26T12:13:26.470178+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:26.470178+0000","last_undegraded":"2024-04-26T12:13:26.470178+0000","last_fullsized":"2024-04-26T12:13:26.470178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470146+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:25.470146+0000","last_peered":"2024-04-26T12:13:25.470146+0000","last_clean":"2024-04-26T12:13:25.470146+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:25.470146+0000","last_undegraded":"2024-04-26T12:13:25.470146+0000","last_fullsized":"2024-04-26T12:13:25.470146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:08.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470437+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:26.470437+0000","last_peered":"2024-04-26T12:13:26.470437+0000","last_clean":"2024-04-26T12:13:26.470437+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:26.470437+0000","last_undegraded":"2024-04-26T12:13:26.470437+0000","last_fullsized":"2024-04-26T12:13:26.470437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:18.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556528+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:25.556528+0000","last_peered":"2024-04-26T12:13:25.556528+0000","last_clean":"2024-04-26T12:13:25.556528+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:25.556528+0000","last_undegraded":"2024-04-26T12:13:25.556528+0000","last_fullsized":"2024-04-26T12:13:25.556528+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:28.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470469+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:13:26.470469+0000","last_peered":"2024-04-26T12:13:26.470469+0000","last_clean":"2024-04-26T12:13:26.470469+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:26.470469+0000","last_undegraded":"2024-04-26T12:13:26.470469+0000","last_fullsized":"2024-04-26T12:13:26.470469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":31,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470033+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:25.470033+0000","last_peered":"2024-04-26T12:13:25.470033+0000","last_clean":"2024-04-26T12:13:25.470033+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:25.470033+0000","last_undegraded":"2024-04-26T12:13:25.470033+0000","last_fullsized":"2024-04-26T12:13:25.470033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:36.499448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470004+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:25.470004+0000","last_peered":"2024-04-26T12:13:25.470004+0000","last_clean":"2024-04-26T12:13:25.470004+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:25.470004+0000","last_undegraded":"2024-04-26T12:13:25.470004+0000","last_fullsized":"2024-04-26T12:13:25.470004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:06.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469561+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:25.469561+0000","last_peered":"2024-04-26T12:13:25.469561+0000","last_clean":"2024-04-26T12:13:25.469561+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:25.469561+0000","last_undegraded":"2024-04-26T12:13:25.469561+0000","last_fullsized":"2024-04-26T12:13:25.469561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.636439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556317+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:13:25.556317+0000","last_peered":"2024-04-26T12:13:25.556317+0000","last_clean":"2024-04-26T12:13:25.556317+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:25.556317+0000","last_undegraded":"2024-04-26T12:13:25.556317+0000","last_fullsized":"2024-04-26T12:13:25.556317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470356+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:26.470356+0000","last_peered":"2024-04-26T12:13:26.470356+0000","last_clean":"2024-04-26T12:13:26.470356+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:26.470356+0000","last_undegraded":"2024-04-26T12:13:26.470356+0000","last_fullsized":"2024-04-26T12:13:26.470356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:34.040588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556733+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:13:25.556733+0000","last_peered":"2024-04-26T12:13:25.556733+0000","last_clean":"2024-04-26T12:13:25.556733+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:25.556733+0000","last_undegraded":"2024-04-26T12:13:25.556733+0000","last_fullsized":"2024-04-26T12:13:25.556733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555973+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:25.555973+0000","last_peered":"2024-04-26T12:13:25.555973+0000","last_clean":"2024-04-26T12:13:25.555973+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:25.555973+0000","last_undegraded":"2024-04-26T12:13:25.555973+0000","last_fullsized":"2024-04-26T12:13:25.555973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:23.129074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471225+0000","last_change":"2024-04-26T12:13:14.392569+0000","last_active":"2024-04-26T12:13:26.471225+0000","last_peered":"2024-04-26T12:13:26.471225+0000","last_clean":"2024-04-26T12:13:26.471225+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:26.471225+0000","last_undegraded":"2024-04-26T12:13:26.471225+0000","last_fullsized":"2024-04-26T12:13:26.471225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":30,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469289+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:25.469289+0000","last_peered":"2024-04-26T12:13:25.469289+0000","last_clean":"2024-04-26T12:13:25.469289+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:25.469289+0000","last_undegraded":"2024-04-26T12:13:25.469289+0000","last_fullsized":"2024-04-26T12:13:25.469289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:07.348907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471306+0000","last_change":"2024-04-26T12:13:14.396669+0000","last_active":"2024-04-26T12:13:26.471306+0000","last_peered":"2024-04-26T12:13:26.471306+0000","last_clean":"2024-04-26T12:13:26.471306+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:26.471306+0000","last_undegraded":"2024-04-26T12:13:26.471306+0000","last_fullsized":"2024-04-26T12:13:26.471306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470330+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:25.470330+0000","last_peered":"2024-04-26T12:13:25.470330+0000","last_clean":"2024-04-26T12:13:25.470330+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:25.470330+0000","last_undegraded":"2024-04-26T12:13:25.470330+0000","last_fullsized":"2024-04-26T12:13:25.470330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555625+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:25.555625+0000","last_peered":"2024-04-26T12:13:25.555625+0000","last_clean":"2024-04-26T12:13:25.555625+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:25.555625+0000","last_undegraded":"2024-04-26T12:13:25.555625+0000","last_fullsized":"2024-04-26T12:13:25.555625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:44.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":81,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556598+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:25.556598+0000","last_peered":"2024-04-26T12:13:25.556598+0000","last_clean":"2024-04-26T12:13:25.556598+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:25.556598+0000","last_undegraded":"2024-04-26T12:13:25.556598+0000","last_fullsized":"2024-04-26T12:13:25.556598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.186277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556093+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:25.556093+0000","last_peered":"2024-04-26T12:13:25.556093+0000","last_clean":"2024-04-26T12:13:25.556093+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:25.556093+0000","last_undegraded":"2024-04-26T12:13:25.556093+0000","last_fullsized":"2024-04-26T12:13:25.556093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469954+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:25.469954+0000","last_peered":"2024-04-26T12:13:25.469954+0000","last_clean":"2024-04-26T12:13:25.469954+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:25.469954+0000","last_undegraded":"2024-04-26T12:13:25.469954+0000","last_fullsized":"2024-04-26T12:13:25.469954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:29.651436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469598+0000","last_change":"2024-04-26T12:13:14.392806+0000","last_active":"2024-04-26T12:13:25.469598+0000","last_peered":"2024-04-26T12:13:25.469598+0000","last_clean":"2024-04-26T12:13:25.469598+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:25.469598+0000","last_undegraded":"2024-04-26T12:13:25.469598+0000","last_fullsized":"2024-04-26T12:13:25.469598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:27.472246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470144+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:25.470144+0000","last_peered":"2024-04-26T12:13:25.470144+0000","last_clean":"2024-04-26T12:13:25.470144+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:25.470144+0000","last_undegraded":"2024-04-26T12:13:25.470144+0000","last_fullsized":"2024-04-26T12:13:25.470144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:43.465677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470638+0000","last_change":"2024-04-26T12:13:14.396914+0000","last_active":"2024-04-26T12:13:26.470638+0000","last_peered":"2024-04-26T12:13:26.470638+0000","last_clean":"2024-04-26T12:13:26.470638+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:26.470638+0000","last_undegraded":"2024-04-26T12:13:26.470638+0000","last_fullsized":"2024-04-26T12:13:26.470638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:33.086082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470602+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:26.470602+0000","last_peered":"2024-04-26T12:13:26.470602+0000","last_clean":"2024-04-26T12:13:26.470602+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:26.470602+0000","last_undegraded":"2024-04-26T12:13:26.470602+0000","last_fullsized":"2024-04-26T12:13:26.470602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:42.180071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469889+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:25.469889+0000","last_peered":"2024-04-26T12:13:25.469889+0000","last_clean":"2024-04-26T12:13:25.469889+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:25.469889+0000","last_undegraded":"2024-04-26T12:13:25.469889+0000","last_fullsized":"2024-04-26T12:13:25.469889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:16.727025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469510+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:25.469510+0000","last_peered":"2024-04-26T12:13:25.469510+0000","last_clean":"2024-04-26T12:13:25.469510+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:25.469510+0000","last_undegraded":"2024-04-26T12:13:25.469510+0000","last_fullsized":"2024-04-26T12:13:25.469510+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:39.928988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470349+0000","last_change":"2024-04-26T12:13:14.394506+0000","last_active":"2024-04-26T12:13:25.470349+0000","last_peered":"2024-04-26T12:13:25.470349+0000","last_clean":"2024-04-26T12:13:25.470349+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:25.470349+0000","last_undegraded":"2024-04-26T12:13:25.470349+0000","last_fullsized":"2024-04-26T12:13:25.470349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:14.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555820+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:25.555820+0000","last_peered":"2024-04-26T12:13:25.555820+0000","last_clean":"2024-04-26T12:13:25.555820+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:25.555820+0000","last_undegraded":"2024-04-26T12:13:25.555820+0000","last_fullsized":"2024-04-26T12:13:25.555820+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:24.717066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470241+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:25.470241+0000","last_peered":"2024-04-26T12:13:25.470241+0000","last_clean":"2024-04-26T12:13:25.470241+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:25.470241+0000","last_undegraded":"2024-04-26T12:13:25.470241+0000","last_fullsized":"2024-04-26T12:13:25.470241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:48.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":66,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555783+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:25.555783+0000","last_peered":"2024-04-26T12:13:25.555783+0000","last_clean":"2024-04-26T12:13:25.555783+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:25.555783+0000","last_undegraded":"2024-04-26T12:13:25.555783+0000","last_fullsized":"2024-04-26T12:13:25.555783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471174+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:26.471174+0000","last_peered":"2024-04-26T12:13:26.471174+0000","last_clean":"2024-04-26T12:13:26.471174+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:26.471174+0000","last_undegraded":"2024-04-26T12:13:26.471174+0000","last_fullsized":"2024-04-26T12:13:26.471174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471166+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:26.471166+0000","last_peered":"2024-04-26T12:13:26.471166+0000","last_clean":"2024-04-26T12:13:26.471166+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:26.471166+0000","last_undegraded":"2024-04-26T12:13:26.471166+0000","last_fullsized":"2024-04-26T12:13:26.471166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556578+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:25.556578+0000","last_peered":"2024-04-26T12:13:25.556578+0000","last_clean":"2024-04-26T12:13:25.556578+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:25.556578+0000","last_undegraded":"2024-04-26T12:13:25.556578+0000","last_fullsized":"2024-04-26T12:13:25.556578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470220+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:26.470220+0000","last_peered":"2024-04-26T12:13:26.470220+0000","last_clean":"2024-04-26T12:13:26.470220+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:26.470220+0000","last_undegraded":"2024-04-26T12:13:26.470220+0000","last_fullsized":"2024-04-26T12:13:26.470220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:31.826247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556329+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:25.556329+0000","last_peered":"2024-04-26T12:13:25.556329+0000","last_clean":"2024-04-26T12:13:25.556329+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:25.556329+0000","last_undegraded":"2024-04-26T12:13:25.556329+0000","last_fullsized":"2024-04-26T12:13:25.556329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:45.968725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471078+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:26.471078+0000","last_peered":"2024-04-26T12:13:26.471078+0000","last_clean":"2024-04-26T12:13:26.471078+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:26.471078+0000","last_undegraded":"2024-04-26T12:13:26.471078+0000","last_fullsized":"2024-04-26T12:13:26.471078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:01.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:52.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470700+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:26.470700+0000","last_peered":"2024-04-26T12:13:26.470700+0000","last_clean":"2024-04-26T12:13:26.470700+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:26.470700+0000","last_undegraded":"2024-04-26T12:13:26.470700+0000","last_fullsized":"2024-04-26T12:13:26.470700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:19.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":220,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469243+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:25.469243+0000","last_peered":"2024-04-26T12:13:25.469243+0000","last_clean":"2024-04-26T12:13:25.469243+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:25.469243+0000","last_undegraded":"2024-04-26T12:13:25.469243+0000","last_fullsized":"2024-04-26T12:13:25.469243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:35.149994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470231+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:26.470231+0000","last_peered":"2024-04-26T12:13:26.470231+0000","last_clean":"2024-04-26T12:13:26.470231+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:26.470231+0000","last_undegraded":"2024-04-26T12:13:26.470231+0000","last_fullsized":"2024-04-26T12:13:26.470231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:51.595471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556850+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:13:25.556850+0000","last_peered":"2024-04-26T12:13:25.556850+0000","last_clean":"2024-04-26T12:13:25.556850+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:25.556850+0000","last_undegraded":"2024-04-26T12:13:25.556850+0000","last_fullsized":"2024-04-26T12:13:25.556850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469686+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:25.469686+0000","last_peered":"2024-04-26T12:13:25.469686+0000","last_clean":"2024-04-26T12:13:25.469686+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:25.469686+0000","last_undegraded":"2024-04-26T12:13:25.469686+0000","last_fullsized":"2024-04-26T12:13:25.469686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.093761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555755+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:25.555755+0000","last_peered":"2024-04-26T12:13:25.555755+0000","last_clean":"2024-04-26T12:13:25.555755+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:25.555755+0000","last_undegraded":"2024-04-26T12:13:25.555755+0000","last_fullsized":"2024-04-26T12:13:25.555755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:22.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469453+0000","last_change":"2024-04-26T12:13:14.392269+0000","last_active":"2024-04-26T12:13:25.469453+0000","last_peered":"2024-04-26T12:13:25.469453+0000","last_clean":"2024-04-26T12:13:25.469453+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:25.469453+0000","last_undegraded":"2024-04-26T12:13:25.469453+0000","last_fullsized":"2024-04-26T12:13:25.469453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:55.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470399+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:26.470399+0000","last_peered":"2024-04-26T12:13:26.470399+0000","last_clean":"2024-04-26T12:13:26.470399+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:26.470399+0000","last_undegraded":"2024-04-26T12:13:26.470399+0000","last_fullsized":"2024-04-26T12:13:26.470399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470084+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:25.470084+0000","last_peered":"2024-04-26T12:13:25.470084+0000","last_clean":"2024-04-26T12:13:25.470084+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:25.470084+0000","last_undegraded":"2024-04-26T12:13:25.470084+0000","last_fullsized":"2024-04-26T12:13:25.470084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:24.319975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555821+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:25.555821+0000","last_peered":"2024-04-26T12:13:25.555821+0000","last_clean":"2024-04-26T12:13:25.555821+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:25.555821+0000","last_undegraded":"2024-04-26T12:13:25.555821+0000","last_fullsized":"2024-04-26T12:13:25.555821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469673+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:25.469673+0000","last_peered":"2024-04-26T12:13:25.469673+0000","last_clean":"2024-04-26T12:13:25.469673+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:25.469673+0000","last_undegraded":"2024-04-26T12:13:25.469673+0000","last_fullsized":"2024-04-26T12:13:25.469673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:03.736741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470868+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:26.470868+0000","last_peered":"2024-04-26T12:13:26.470868+0000","last_clean":"2024-04-26T12:13:26.470868+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:26.470868+0000","last_undegraded":"2024-04-26T12:13:26.470868+0000","last_fullsized":"2024-04-26T12:13:26.470868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556723+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:25.556723+0000","last_peered":"2024-04-26T12:13:25.556723+0000","last_clean":"2024-04-26T12:13:25.556723+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:25.556723+0000","last_undegraded":"2024-04-26T12:13:25.556723+0000","last_fullsized":"2024-04-26T12:13:25.556723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:57.924425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470966+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:26.470966+0000","last_peered":"2024-04-26T12:13:26.470966+0000","last_clean":"2024-04-26T12:13:26.470966+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:26.470966+0000","last_undegraded":"2024-04-26T12:13:26.470966+0000","last_fullsized":"2024-04-26T12:13:26.470966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470035+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:25.470035+0000","last_peered":"2024-04-26T12:13:25.470035+0000","last_clean":"2024-04-26T12:13:25.470035+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:25.470035+0000","last_undegraded":"2024-04-26T12:13:25.470035+0000","last_fullsized":"2024-04-26T12:13:25.470035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:17.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470195+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:25.470195+0000","last_peered":"2024-04-26T12:13:25.470195+0000","last_clean":"2024-04-26T12:13:25.470195+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:25.470195+0000","last_undegraded":"2024-04-26T12:13:25.470195+0000","last_fullsized":"2024-04-26T12:13:25.470195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:30.589803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556118+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:25.556118+0000","last_peered":"2024-04-26T12:13:25.556118+0000","last_clean":"2024-04-26T12:13:25.556118+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:25.556118+0000","last_undegraded":"2024-04-26T12:13:25.556118+0000","last_fullsized":"2024-04-26T12:13:25.556118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556109+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:25.556109+0000","last_peered":"2024-04-26T12:13:25.556109+0000","last_clean":"2024-04-26T12:13:25.556109+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:25.556109+0000","last_undegraded":"2024-04-26T12:13:25.556109+0000","last_fullsized":"2024-04-26T12:13:25.556109+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556413+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:25.556413+0000","last_peered":"2024-04-26T12:13:25.556413+0000","last_clean":"2024-04-26T12:13:25.556413+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:25.556413+0000","last_undegraded":"2024-04-26T12:13:25.556413+0000","last_fullsized":"2024-04-26T12:13:25.556413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469843+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:25.469843+0000","last_peered":"2024-04-26T12:13:25.469843+0000","last_clean":"2024-04-26T12:13:25.469843+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:25.469843+0000","last_undegraded":"2024-04-26T12:13:25.469843+0000","last_fullsized":"2024-04-26T12:13:25.469843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.214997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469946+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:25.469946+0000","last_peered":"2024-04-26T12:13:25.469946+0000","last_clean":"2024-04-26T12:13:25.469946+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:25.469946+0000","last_undegraded":"2024-04-26T12:13:25.469946+0000","last_fullsized":"2024-04-26T12:13:25.469946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.878980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":35,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469967+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:25.469967+0000","last_peered":"2024-04-26T12:13:25.469967+0000","last_clean":"2024-04-26T12:13:25.469967+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:25.469967+0000","last_undegraded":"2024-04-26T12:13:25.469967+0000","last_fullsized":"2024-04-26T12:13:25.469967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:33.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469576+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:25.469576+0000","last_peered":"2024-04-26T12:13:25.469576+0000","last_clean":"2024-04-26T12:13:25.469576+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:25.469576+0000","last_undegraded":"2024-04-26T12:13:25.469576+0000","last_fullsized":"2024-04-26T12:13:25.469576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:25.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471000+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:26.471000+0000","last_peered":"2024-04-26T12:13:26.471000+0000","last_clean":"2024-04-26T12:13:26.471000+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:26.471000+0000","last_undegraded":"2024-04-26T12:13:26.471000+0000","last_fullsized":"2024-04-26T12:13:26.471000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556129+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:25.556129+0000","last_peered":"2024-04-26T12:13:25.556129+0000","last_clean":"2024-04-26T12:13:25.556129+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:25.556129+0000","last_undegraded":"2024-04-26T12:13:25.556129+0000","last_fullsized":"2024-04-26T12:13:25.556129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.396440+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469405+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:25.469405+0000","last_peered":"2024-04-26T12:13:25.469405+0000","last_clean":"2024-04-26T12:13:25.469405+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:25.469405+0000","last_undegraded":"2024-04-26T12:13:25.469405+0000","last_fullsized":"2024-04-26T12:13:25.469405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:25.593914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469336+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:25.469336+0000","last_peered":"2024-04-26T12:13:25.469336+0000","last_clean":"2024-04-26T12:13:25.469336+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:25.469336+0000","last_undegraded":"2024-04-26T12:13:25.469336+0000","last_fullsized":"2024-04-26T12:13:25.469336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470322+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:13:26.470322+0000","last_peered":"2024-04-26T12:13:26.470322+0000","last_clean":"2024-04-26T12:13:26.470322+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:26.470322+0000","last_undegraded":"2024-04-26T12:13:26.470322+0000","last_fullsized":"2024-04-26T12:13:26.470322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556132+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:25.556132+0000","last_peered":"2024-04-26T12:13:25.556132+0000","last_clean":"2024-04-26T12:13:25.556132+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:25.556132+0000","last_undegraded":"2024-04-26T12:13:25.556132+0000","last_fullsized":"2024-04-26T12:13:25.556132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:48.553812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470936+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:26.470936+0000","last_peered":"2024-04-26T12:13:26.470936+0000","last_clean":"2024-04-26T12:13:26.470936+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:26.470936+0000","last_undegraded":"2024-04-26T12:13:26.470936+0000","last_fullsized":"2024-04-26T12:13:26.470936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556493+0000","last_change":"2024-04-26T12:13:14.394918+0000","last_active":"2024-04-26T12:13:25.556493+0000","last_peered":"2024-04-26T12:13:25.556493+0000","last_clean":"2024-04-26T12:13:25.556493+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:25.556493+0000","last_undegraded":"2024-04-26T12:13:25.556493+0000","last_fullsized":"2024-04-26T12:13:25.556493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002812,"statfs":{"total":96636764160,"available":96258879488,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.55900000000000005}]}]},{"osd":0,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289228,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082612,"statfs":{"total":96636764160,"available":96340594688,"internally_reserved":0,"allocated":1376256,"data_stored":889844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Apr 26 12:12:49 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.76900000000000002,"5min":2.214,"15min":2.214},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.42499999999999999},"min":{"1min":0.19500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.8440000000000001,"5min":2.294,"15min":2.294},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:32.448 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:13:32.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:32.856 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:32.869 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-26T12:13:30.922997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702384,"kb_used_data":3468,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413136,"statfs":{"total":289910292480,"available":289191051264,"internally_reserved":0,"allocated":3551232,"data_stored":2091482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556896+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:13:25.556896+0000","last_peered":"2024-04-26T12:13:25.556896+0000","last_clean":"2024-04-26T12:13:25.556896+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:25.556896+0000","last_undegraded":"2024-04-26T12:13:25.556896+0000","last_fullsized":"2024-04-26T12:13:25.556896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556602+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:25.556602+0000","last_peered":"2024-04-26T12:13:25.556602+0000","last_clean":"2024-04-26T12:13:25.556602+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:25.556602+0000","last_undegraded":"2024-04-26T12:13:25.556602+0000","last_fullsized":"2024-04-26T12:13:25.556602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470206+0000","last_change":"2024-04-26T12:13:14.393093+0000","last_active":"2024-04-26T12:13:25.470206+0000","last_peered":"2024-04-26T12:13:25.470206+0000","last_clean":"2024-04-26T12:13:25.470206+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:25.470206+0000","last_undegraded":"2024-04-26T12:13:25.470206+0000","last_fullsized":"2024-04-26T12:13:25.470206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:53.974372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469991+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:25.469991+0000","last_peered":"2024-04-26T12:13:25.469991+0000","last_clean":"2024-04-26T12:13:25.469991+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:25.469991+0000","last_undegraded":"2024-04-26T12:13:25.469991+0000","last_fullsized":"2024-04-26T12:13:25.469991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:57.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555963+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:25.555963+0000","last_peered":"2024-04-26T12:13:25.555963+0000","last_clean":"2024-04-26T12:13:25.555963+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:25.555963+0000","last_undegraded":"2024-04-26T12:13:25.555963+0000","last_fullsized":"2024-04-26T12:13:25.555963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469418+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:25.469418+0000","last_peered":"2024-04-26T12:13:25.469418+0000","last_clean":"2024-04-26T12:13:25.469418+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:25.469418+0000","last_undegraded":"2024-04-26T12:13:25.469418+0000","last_fullsized":"2024-04-26T12:13:25.469418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:21.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469383+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:25.469383+0000","last_peered":"2024-04-26T12:13:25.469383+0000","last_clean":"2024-04-26T12:13:25.469383+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:25.469383+0000","last_undegraded":"2024-04-26T12:13:25.469383+0000","last_fullsized":"2024-04-26T12:13:25.469383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:49.959427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469164+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:25.469164+0000","last_peered":"2024-04-26T12:13:25.469164+0000","last_clean":"2024-04-26T12:13:25.469164+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:25.469164+0000","last_undegraded":"2024-04-26T12:13:25.469164+0000","last_fullsized":"2024-04-26T12:13:25.469164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:03.771898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471091+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:26.471091+0000","last_peered":"2024-04-26T12:13:26.471091+0000","last_clean":"2024-04-26T12:13:26.471091+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:26.471091+0000","last_undegraded":"2024-04-26T12:13:26.471091+0000","last_fullsized":"2024-04-26T12:13:26.471091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556820+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:25.556820+0000","last_peered":"2024-04-26T12:13:25.556820+0000","last_clean":"2024-04-26T12:13:25.556820+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:25.556820+0000","last_undegraded":"2024-04-26T12:13:25.556820+0000","last_fullsized":"2024-04-26T12:13:25.556820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470312+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:25.470312+0000","last_peered":"2024-04-26T12:13:25.470312+0000","last_clean":"2024-04-26T12:13:25.470312+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:25.470312+0000","last_undegraded":"2024-04-26T12:13:25.470312+0000","last_fullsized":"2024-04-26T12:13:25.470312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:33.110932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556259+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:25.556259+0000","last_peered":"2024-04-26T12:13:25.556259+0000","last_clean":"2024-04-26T12:13:25.556259+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:25.556259+0000","last_undegraded":"2024-04-26T12:13:25.556259+0000","last_fullsized":"2024-04-26T12:13:25.556259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:29.958220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556152+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:13:25.556152+0000","last_peered":"2024-04-26T12:13:25.556152+0000","last_clean":"2024-04-26T12:13:25.556152+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:25.556152+0000","last_undegraded":"2024-04-26T12:13:25.556152+0000","last_fullsized":"2024-04-26T12:13:25.556152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469707+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:25.469707+0000","last_peered":"2024-04-26T12:13:25.469707+0000","last_clean":"2024-04-26T12:13:25.469707+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:25.469707+0000","last_undegraded":"2024-04-26T12:13:25.469707+0000","last_fullsized":"2024-04-26T12:13:25.469707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:45.547385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469637+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:25.469637+0000","last_peered":"2024-04-26T12:13:25.469637+0000","last_clean":"2024-04-26T12:13:25.469637+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:25.469637+0000","last_undegraded":"2024-04-26T12:13:25.469637+0000","last_fullsized":"2024-04-26T12:13:25.469637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469513+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:25.469513+0000","last_peered":"2024-04-26T12:13:25.469513+0000","last_clean":"2024-04-26T12:13:25.469513+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:25.469513+0000","last_undegraded":"2024-04-26T12:13:25.469513+0000","last_fullsized":"2024-04-26T12:13:25.469513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:19.229847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471104+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:26.471104+0000","last_peered":"2024-04-26T12:13:26.471104+0000","last_clean":"2024-04-26T12:13:26.471104+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:26.471104+0000","last_undegraded":"2024-04-26T12:13:26.471104+0000","last_fullsized":"2024-04-26T12:13:26.471104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556739+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:25.556739+0000","last_peered":"2024-04-26T12:13:25.556739+0000","last_clean":"2024-04-26T12:13:25.556739+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:25.556739+0000","last_undegraded":"2024-04-26T12:13:25.556739+0000","last_fullsized":"2024-04-26T12:13:25.556739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470865+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:26.470865+0000","last_peered":"2024-04-26T12:13:26.470865+0000","last_clean":"2024-04-26T12:13:26.470865+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:26.470865+0000","last_undegraded":"2024-04-26T12:13:26.470865+0000","last_fullsized":"2024-04-26T12:13:26.470865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470090+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:25.470090+0000","last_peered":"2024-04-26T12:13:25.470090+0000","last_clean":"2024-04-26T12:13:25.470090+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:25.470090+0000","last_undegraded":"2024-04-26T12:13:25.470090+0000","last_fullsized":"2024-04-26T12:13:25.470090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:07.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469579+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:25.469579+0000","last_peered":"2024-04-26T12:13:25.469579+0000","last_clean":"2024-04-26T12:13:25.469579+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:25.469579+0000","last_undegraded":"2024-04-26T12:13:25.469579+0000","last_fullsized":"2024-04-26T12:13:25.469579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:49.995173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556027+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:25.556027+0000","last_peered":"2024-04-26T12:13:25.556027+0000","last_clean":"2024-04-26T12:13:25.556027+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:25.556027+0000","last_undegraded":"2024-04-26T12:13:25.556027+0000","last_fullsized":"2024-04-26T12:13:25.556027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:21.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470536+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:26.470536+0000","last_peered":"2024-04-26T12:13:26.470536+0000","last_clean":"2024-04-26T12:13:26.470536+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:26.470536+0000","last_undegraded":"2024-04-26T12:13:26.470536+0000","last_fullsized":"2024-04-26T12:13:26.470536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556824+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:25.556824+0000","last_peered":"2024-04-26T12:13:25.556824+0000","last_clean":"2024-04-26T12:13:25.556824+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:25.556824+0000","last_undegraded":"2024-04-26T12:13:25.556824+0000","last_fullsized":"2024-04-26T12:13:25.556824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:04.826156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470956+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:26.470956+0000","last_peered":"2024-04-26T12:13:26.470956+0000","last_clean":"2024-04-26T12:13:26.470956+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:26.470956+0000","last_undegraded":"2024-04-26T12:13:26.470956+0000","last_fullsized":"2024-04-26T12:13:26.470956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:32.586178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470373+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:25.470373+0000","last_peered":"2024-04-26T12:13:25.470373+0000","last_clean":"2024-04-26T12:13:25.470373+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:25.470373+0000","last_undegraded":"2024-04-26T12:13:25.470373+0000","last_fullsized":"2024-04-26T12:13:25.470373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:43.755438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555985+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:25.555985+0000","last_peered":"2024-04-26T12:13:25.555985+0000","last_clean":"2024-04-26T12:13:25.555985+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:25.555985+0000","last_undegraded":"2024-04-26T12:13:25.555985+0000","last_fullsized":"2024-04-26T12:13:25.555985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556628+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:25.556628+0000","last_peered":"2024-04-26T12:13:25.556628+0000","last_clean":"2024-04-26T12:13:25.556628+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:25.556628+0000","last_undegraded":"2024-04-26T12:13:25.556628+0000","last_fullsized":"2024-04-26T12:13:25.556628+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470431+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:26.470431+0000","last_peered":"2024-04-26T12:13:26.470431+0000","last_clean":"2024-04-26T12:13:26.470431+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:26.470431+0000","last_undegraded":"2024-04-26T12:13:26.470431+0000","last_fullsized":"2024-04-26T12:13:26.470431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:33.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471084+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:26.471084+0000","last_peered":"2024-04-26T12:13:26.471084+0000","last_clean":"2024-04-26T12:13:26.471084+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:26.471084+0000","last_undegraded":"2024-04-26T12:13:26.471084+0000","last_fullsized":"2024-04-26T12:13:26.471084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.984438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470294+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:26.470294+0000","last_peered":"2024-04-26T12:13:26.470294+0000","last_clean":"2024-04-26T12:13:26.470294+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:26.470294+0000","last_undegraded":"2024-04-26T12:13:26.470294+0000","last_fullsized":"2024-04-26T12:13:26.470294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556818+0000","last_change":"2024-04-26T12:13:14.393885+0000","last_active":"2024-04-26T12:13:25.556818+0000","last_peered":"2024-04-26T12:13:25.556818+0000","last_clean":"2024-04-26T12:13:25.556818+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:25.556818+0000","last_undegraded":"2024-04-26T12:13:25.556818+0000","last_fullsized":"2024-04-26T12:13:25.556818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:37.146713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471245+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:26.471245+0000","last_peered":"2024-04-26T12:13:26.471245+0000","last_clean":"2024-04-26T12:13:26.471245+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:26.471245+0000","last_undegraded":"2024-04-26T12:13:26.471245+0000","last_fullsized":"2024-04-26T12:13:26.471245+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:07.033491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470178+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:13:26.470178+0000","last_peered":"2024-04-26T12:13:26.470178+0000","last_clean":"2024-04-26T12:13:26.470178+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:26.470178+0000","last_undegraded":"2024-04-26T12:13:26.470178+0000","last_fullsized":"2024-04-26T12:13:26.470178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470146+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:25.470146+0000","last_peered":"2024-04-26T12:13:25.470146+0000","last_clean":"2024-04-26T12:13:25.470146+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:25.470146+0000","last_undegraded":"2024-04-26T12:13:25.470146+0000","last_fullsized":"2024-04-26T12:13:25.470146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:08.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470437+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:26.470437+0000","last_peered":"2024-04-26T12:13:26.470437+0000","last_clean":"2024-04-26T12:13:26.470437+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:26.470437+0000","last_undegraded":"2024-04-26T12:13:26.470437+0000","last_fullsized":"2024-04-26T12:13:26.470437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:18.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556528+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:25.556528+0000","last_peered":"2024-04-26T12:13:25.556528+0000","last_clean":"2024-04-26T12:13:25.556528+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:25.556528+0000","last_undegraded":"2024-04-26T12:13:25.556528+0000","last_fullsized":"2024-04-26T12:13:25.556528+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:28.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470469+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:13:26.470469+0000","last_peered":"2024-04-26T12:13:26.470469+0000","last_clean":"2024-04-26T12:13:26.470469+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:26.470469+0000","last_undegraded":"2024-04-26T12:13:26.470469+0000","last_fullsized":"2024-04-26T12:13:26.470469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":31,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470033+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:25.470033+0000","last_peered":"2024-04-26T12:13:25.470033+0000","last_clean":"2024-04-26T12:13:25.470033+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:25.470033+0000","last_undegraded":"2024-04-26T12:13:25.470033+0000","last_fullsized":"2024-04-26T12:13:25.470033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:36.499448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470004+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:25.470004+0000","last_peered":"2024-04-26T12:13:25.470004+0000","last_clean":"2024-04-26T12:13:25.470004+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:25.470004+0000","last_undegraded":"2024-04-26T12:13:25.470004+0000","last_fullsized":"2024-04-26T12:13:25.470004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:06.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469561+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:25.469561+0000","last_peered":"2024-04-26T12:13:25.469561+0000","last_clean":"2024-04-26T12:13:25.469561+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:25.469561+0000","last_undegraded":"2024-04-26T12:13:25.469561+0000","last_fullsized":"2024-04-26T12:13:25.469561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.636439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556317+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:13:25.556317+0000","last_peered":"2024-04-26T12:13:25.556317+0000","last_clean":"2024-04-26T12:13:25.556317+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:25.556317+0000","last_undegraded":"2024-04-26T12:13:25.556317+0000","last_fullsized":"2024-04-26T12:13:25.556317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470356+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:26.470356+0000","last_peered":"2024-04-26T12:13:26.470356+0000","last_clean":"2024-04-26T12:13:26.470356+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:26.470356+0000","last_undegraded":"2024-04-26T12:13:26.470356+0000","last_fullsized":"2024-04-26T12:13:26.470356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:34.040588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556733+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:13:25.556733+0000","last_peered":"2024-04-26T12:13:25.556733+0000","last_clean":"2024-04-26T12:13:25.556733+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:25.556733+0000","last_undegraded":"2024-04-26T12:13:25.556733+0000","last_fullsized":"2024-04-26T12:13:25.556733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555973+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:25.555973+0000","last_peered":"2024-04-26T12:13:25.555973+0000","last_clean":"2024-04-26T12:13:25.555973+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:25.555973+0000","last_undegraded":"2024-04-26T12:13:25.555973+0000","last_fullsized":"2024-04-26T12:13:25.555973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:23.129074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471225+0000","last_change":"2024-04-26T12:13:14.392569+0000","last_active":"2024-04-26T12:13:26.471225+0000","last_peered":"2024-04-26T12:13:26.471225+0000","last_clean":"2024-04-26T12:13:26.471225+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:26.471225+0000","last_undegraded":"2024-04-26T12:13:26.471225+0000","last_fullsized":"2024-04-26T12:13:26.471225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":30,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469289+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:25.469289+0000","last_peered":"2024-04-26T12:13:25.469289+0000","last_clean":"2024-04-26T12:13:25.469289+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:25.469289+0000","last_undegraded":"2024-04-26T12:13:25.469289+0000","last_fullsized":"2024-04-26T12:13:25.469289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:07.348907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471306+0000","last_change":"2024-04-26T12:13:14.396669+0000","last_active":"2024-04-26T12:13:26.471306+0000","last_peered":"2024-04-26T12:13:26.471306+0000","last_clean":"2024-04-26T12:13:26.471306+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:26.471306+0000","last_undegraded":"2024-04-26T12:13:26.471306+0000","last_fullsized":"2024-04-26T12:13:26.471306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470330+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:25.470330+0000","last_peered":"2024-04-26T12:13:25.470330+0000","last_clean":"2024-04-26T12:13:25.470330+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:25.470330+0000","last_undegraded":"2024-04-26T12:13:25.470330+0000","last_fullsized":"2024-04-26T12:13:25.470330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555625+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:25.555625+0000","last_peered":"2024-04-26T12:13:25.555625+0000","last_clean":"2024-04-26T12:13:25.555625+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:25.555625+0000","last_undegraded":"2024-04-26T12:13:25.555625+0000","last_fullsized":"2024-04-26T12:13:25.555625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:44.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":81,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556598+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:25.556598+0000","last_peered":"2024-04-26T12:13:25.556598+0000","last_clean":"2024-04-26T12:13:25.556598+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:25.556598+0000","last_undegraded":"2024-04-26T12:13:25.556598+0000","last_fullsized":"2024-04-26T12:13:25.556598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.186277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556093+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:25.556093+0000","last_peered":"2024-04-26T12:13:25.556093+0000","last_clean":"2024-04-26T12:13:25.556093+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:25.556093+0000","last_undegraded":"2024-04-26T12:13:25.556093+0000","last_fullsized":"2024-04-26T12:13:25.556093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469954+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:25.469954+0000","last_peered":"2024-04-26T12:13:25.469954+0000","last_clean":"2024-04-26T12:13:25.469954+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:25.469954+0000","last_undegraded":"2024-04-26T12:13:25.469954+0000","last_fullsized":"2024-04-26T12:13:25.469954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:29.651436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469598+0000","last_change":"2024-04-26T12:13:14.392806+0000","last_active":"2024-04-26T12:13:25.469598+0000","last_peered":"2024-04-26T12:13:25.469598+0000","last_clean":"2024-04-26T12:13:25.469598+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:25.469598+0000","last_undegraded":"2024-04-26T12:13:25.469598+0000","last_fullsized":"2024-04-26T12:13:25.469598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:27.472246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470144+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:25.470144+0000","last_peered":"2024-04-26T12:13:25.470144+0000","last_clean":"2024-04-26T12:13:25.470144+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:25.470144+0000","last_undegraded":"2024-04-26T12:13:25.470144+0000","last_fullsized":"2024-04-26T12:13:25.470144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:43.465677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470638+0000","last_change":"2024-04-26T12:13:14.396914+0000","last_active":"2024-04-26T12:13:26.470638+0000","last_peered":"2024-04-26T12:13:26.470638+0000","last_clean":"2024-04-26T12:13:26.470638+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:26.470638+0000","last_undegraded":"2024-04-26T12:13:26.470638+0000","last_fullsized":"2024-04-26T12:13:26.470638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:33.086082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470602+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:26.470602+0000","last_peered":"2024-04-26T12:13:26.470602+0000","last_clean":"2024-04-26T12:13:26.470602+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:26.470602+0000","last_undegraded":"2024-04-26T12:13:26.470602+0000","last_fullsized":"2024-04-26T12:13:26.470602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:42.180071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469889+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:25.469889+0000","last_peered":"2024-04-26T12:13:25.469889+0000","last_clean":"2024-04-26T12:13:25.469889+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:25.469889+0000","last_undegraded":"2024-04-26T12:13:25.469889+0000","last_fullsized":"2024-04-26T12:13:25.469889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:16.727025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469510+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:25.469510+0000","last_peered":"2024-04-26T12:13:25.469510+0000","last_clean":"2024-04-26T12:13:25.469510+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:25.469510+0000","last_undegraded":"2024-04-26T12:13:25.469510+0000","last_fullsized":"2024-04-26T12:13:25.469510+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:39.928988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470349+0000","last_change":"2024-04-26T12:13:14.394506+0000","last_active":"2024-04-26T12:13:25.470349+0000","last_peered":"2024-04-26T12:13:25.470349+0000","last_clean":"2024-04-26T12:13:25.470349+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:25.470349+0000","last_undegraded":"2024-04-26T12:13:25.470349+0000","last_fullsized":"2024-04-26T12:13:25.470349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:14.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555820+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:25.555820+0000","last_peered":"2024-04-26T12:13:25.555820+0000","last_clean":"2024-04-26T12:13:25.555820+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:25.555820+0000","last_undegraded":"2024-04-26T12:13:25.555820+0000","last_fullsized":"2024-04-26T12:13:25.555820+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:24.717066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470241+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:25.470241+0000","last_peered":"2024-04-26T12:13:25.470241+0000","last_clean":"2024-04-26T12:13:25.470241+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:25.470241+0000","last_undegraded":"2024-04-26T12:13:25.470241+0000","last_fullsized":"2024-04-26T12:13:25.470241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:48.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":66,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555783+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:25.555783+0000","last_peered":"2024-04-26T12:13:25.555783+0000","last_clean":"2024-04-26T12:13:25.555783+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:25.555783+0000","last_undegraded":"2024-04-26T12:13:25.555783+0000","last_fullsized":"2024-04-26T12:13:25.555783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471174+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:26.471174+0000","last_peered":"2024-04-26T12:13:26.471174+0000","last_clean":"2024-04-26T12:13:26.471174+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:26.471174+0000","last_undegraded":"2024-04-26T12:13:26.471174+0000","last_fullsized":"2024-04-26T12:13:26.471174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471166+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:26.471166+0000","last_peered":"2024-04-26T12:13:26.471166+0000","last_clean":"2024-04-26T12:13:26.471166+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:26.471166+0000","last_undegraded":"2024-04-26T12:13:26.471166+0000","last_fullsized":"2024-04-26T12:13:26.471166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556578+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:25.556578+0000","last_peered":"2024-04-26T12:13:25.556578+0000","last_clean":"2024-04-26T12:13:25.556578+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:25.556578+0000","last_undegraded":"2024-04-26T12:13:25.556578+0000","last_fullsized":"2024-04-26T12:13:25.556578+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470220+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:26.470220+0000","last_peered":"2024-04-26T12:13:26.470220+0000","last_clean":"2024-04-26T12:13:26.470220+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:26.470220+0000","last_undegraded":"2024-04-26T12:13:26.470220+0000","last_fullsized":"2024-04-26T12:13:26.470220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:31.826247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556329+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:25.556329+0000","last_peered":"2024-04-26T12:13:25.556329+0000","last_clean":"2024-04-26T12:13:25.556329+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:25.556329+0000","last_undegraded":"2024-04-26T12:13:25.556329+0000","last_fullsized":"2024-04-26T12:13:25.556329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:45.968725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471078+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:26.471078+0000","last_peered":"2024-04-26T12:13:26.471078+0000","last_clean":"2024-04-26T12:13:26.471078+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:26.471078+0000","last_undegraded":"2024-04-26T12:13:26.471078+0000","last_fullsized":"2024-04-26T12:13:26.471078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:01.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:52.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470700+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:26.470700+0000","last_peered":"2024-04-26T12:13:26.470700+0000","last_clean":"2024-04-26T12:13:26.470700+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:26.470700+0000","last_undegraded":"2024-04-26T12:13:26.470700+0000","last_fullsized":"2024-04-26T12:13:26.470700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:19.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":220,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469243+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:25.469243+0000","last_peered":"2024-04-26T12:13:25.469243+0000","last_clean":"2024-04-26T12:13:25.469243+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:25.469243+0000","last_undegraded":"2024-04-26T12:13:25.469243+0000","last_fullsized":"2024-04-26T12:13:25.469243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:35.149994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470231+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:26.470231+0000","last_peered":"2024-04-26T12:13:26.470231+0000","last_clean":"2024-04-26T12:13:26.470231+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:26.470231+0000","last_undegraded":"2024-04-26T12:13:26.470231+0000","last_fullsized":"2024-04-26T12:13:26.470231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:51.595471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556850+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:13:25.556850+0000","last_peered":"2024-04-26T12:13:25.556850+0000","last_clean":"2024-04-26T12:13:25.556850+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:25.556850+0000","last_undegraded":"2024-04-26T12:13:25.556850+0000","last_fullsized":"2024-04-26T12:13:25.556850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469686+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:25.469686+0000","last_peered":"2024-04-26T12:13:25.469686+0000","last_clean":"2024-04-26T12:13:25.469686+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:25.469686+0000","last_undegraded":"2024-04-26T12:13:25.469686+0000","last_fullsized":"2024-04-26T12:13:25.469686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.093761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555755+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:25.555755+0000","last_peered":"2024-04-26T12:13:25.555755+0000","last_clean":"2024-04-26T12:13:25.555755+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:25.555755+0000","last_undegraded":"2024-04-26T12:13:25.555755+0000","last_fullsized":"2024-04-26T12:13:25.555755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:22.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469453+0000","last_change":"2024-04-26T12:13:14.392269+0000","last_active":"2024-04-26T12:13:25.469453+0000","last_peered":"2024-04-26T12:13:25.469453+0000","last_clean":"2024-04-26T12:13:25.469453+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:25.469453+0000","last_undegraded":"2024-04-26T12:13:25.469453+0000","last_fullsized":"2024-04-26T12:13:25.469453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:55.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470399+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:26.470399+0000","last_peered":"2024-04-26T12:13:26.470399+0000","last_clean":"2024-04-26T12:13:26.470399+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:26.470399+0000","last_undegraded":"2024-04-26T12:13:26.470399+0000","last_fullsized":"2024-04-26T12:13:26.470399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470084+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:25.470084+0000","last_peered":"2024-04-26T12:13:25.470084+0000","last_clean":"2024-04-26T12:13:25.470084+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:25.470084+0000","last_undegraded":"2024-04-26T12:13:25.470084+0000","last_fullsized":"2024-04-26T12:13:25.470084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:24.319975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555821+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:25.555821+0000","last_peered":"2024-04-26T12:13:25.555821+0000","last_clean":"2024-04-26T12:13:25.555821+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:25.555821+0000","last_undegraded":"2024-04-26T12:13:25.555821+0000","last_fullsized":"2024-04-26T12:13:25.555821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469673+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:25.469673+0000","last_peered":"2024-04-26T12:13:25.469673+0000","last_clean":"2024-04-26T12:13:25.469673+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:25.469673+0000","last_undegraded":"2024-04-26T12:13:25.469673+0000","last_fullsized":"2024-04-26T12:13:25.469673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:03.736741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470868+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:26.470868+0000","last_peered":"2024-04-26T12:13:26.470868+0000","last_clean":"2024-04-26T12:13:26.470868+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:26.470868+0000","last_undegraded":"2024-04-26T12:13:26.470868+0000","last_fullsized":"2024-04-26T12:13:26.470868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556723+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:25.556723+0000","last_peered":"2024-04-26T12:13:25.556723+0000","last_clean":"2024-04-26T12:13:25.556723+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:25.556723+0000","last_undegraded":"2024-04-26T12:13:25.556723+0000","last_fullsized":"2024-04-26T12:13:25.556723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:57.924425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470966+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:26.470966+0000","last_peered":"2024-04-26T12:13:26.470966+0000","last_clean":"2024-04-26T12:13:26.470966+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:26.470966+0000","last_undegraded":"2024-04-26T12:13:26.470966+0000","last_fullsized":"2024-04-26T12:13:26.470966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.555998+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:25.555998+0000","last_peered":"2024-04-26T12:13:25.555998+0000","last_clean":"2024-04-26T12:13:25.555998+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:25.555998+0000","last_undegraded":"2024-04-26T12:13:25.555998+0000","last_fullsized":"2024-04-26T12:13:25.555998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470035+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:25.470035+0000","last_peered":"2024-04-26T12:13:25.470035+0000","last_clean":"2024-04-26T12:13:25.470035+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:25.470035+0000","last_undegraded":"2024-04-26T12:13:25.470035+0000","last_fullsized":"2024-04-26T12:13:25.470035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:17.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470195+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:25.470195+0000","last_peered":"2024-04-26T12:13:25.470195+0000","last_clean":"2024-04-26T12:13:25.470195+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:25.470195+0000","last_undegraded":"2024-04-26T12:13:25.470195+0000","last_fullsized":"2024-04-26T12:13:25.470195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:30.589803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556118+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:25.556118+0000","last_peered":"2024-04-26T12:13:25.556118+0000","last_clean":"2024-04-26T12:13:25.556118+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:25.556118+0000","last_undegraded":"2024-04-26T12:13:25.556118+0000","last_fullsized":"2024-04-26T12:13:25.556118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556109+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:25.556109+0000","last_peered":"2024-04-26T12:13:25.556109+0000","last_clean":"2024-04-26T12:13:25.556109+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:25.556109+0000","last_undegraded":"2024-04-26T12:13:25.556109+0000","last_fullsized":"2024-04-26T12:13:25.556109+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556413+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:25.556413+0000","last_peered":"2024-04-26T12:13:25.556413+0000","last_clean":"2024-04-26T12:13:25.556413+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:25.556413+0000","last_undegraded":"2024-04-26T12:13:25.556413+0000","last_fullsized":"2024-04-26T12:13:25.556413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469843+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:25.469843+0000","last_peered":"2024-04-26T12:13:25.469843+0000","last_clean":"2024-04-26T12:13:25.469843+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:25.469843+0000","last_undegraded":"2024-04-26T12:13:25.469843+0000","last_fullsized":"2024-04-26T12:13:25.469843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.214997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469946+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:25.469946+0000","last_peered":"2024-04-26T12:13:25.469946+0000","last_clean":"2024-04-26T12:13:25.469946+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:25.469946+0000","last_undegraded":"2024-04-26T12:13:25.469946+0000","last_fullsized":"2024-04-26T12:13:25.469946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.878980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":35,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469967+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:25.469967+0000","last_peered":"2024-04-26T12:13:25.469967+0000","last_clean":"2024-04-26T12:13:25.469967+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:25.469967+0000","last_undegraded":"2024-04-26T12:13:25.469967+0000","last_fullsized":"2024-04-26T12:13:25.469967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:33.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469576+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:25.469576+0000","last_peered":"2024-04-26T12:13:25.469576+0000","last_clean":"2024-04-26T12:13:25.469576+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:25.469576+0000","last_undegraded":"2024-04-26T12:13:25.469576+0000","last_fullsized":"2024-04-26T12:13:25.469576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:25.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471000+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:26.471000+0000","last_peered":"2024-04-26T12:13:26.471000+0000","last_clean":"2024-04-26T12:13:26.471000+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:26.471000+0000","last_undegraded":"2024-04-26T12:13:26.471000+0000","last_fullsized":"2024-04-26T12:13:26.471000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556129+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:25.556129+0000","last_peered":"2024-04-26T12:13:25.556129+0000","last_clean":"2024-04-26T12:13:25.556129+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:25.556129+0000","last_undegraded":"2024-04-26T12:13:25.556129+0000","last_fullsized":"2024-04-26T12:13:25.556129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.396440+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469405+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:25.469405+0000","last_peered":"2024-04-26T12:13:25.469405+0000","last_clean":"2024-04-26T12:13:25.469405+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:25.469405+0000","last_undegraded":"2024-04-26T12:13:25.469405+0000","last_fullsized":"2024-04-26T12:13:25.469405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:25.593914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469336+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:25.469336+0000","last_peered":"2024-04-26T12:13:25.469336+0000","last_clean":"2024-04-26T12:13:25.469336+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:25.469336+0000","last_undegraded":"2024-04-26T12:13:25.469336+0000","last_fullsized":"2024-04-26T12:13:25.469336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470322+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:13:26.470322+0000","last_peered":"2024-04-26T12:13:26.470322+0000","last_clean":"2024-04-26T12:13:26.470322+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:26.470322+0000","last_undegraded":"2024-04-26T12:13:26.470322+0000","last_fullsized":"2024-04-26T12:13:26.470322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556132+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:25.556132+0000","last_peered":"2024-04-26T12:13:25.556132+0000","last_clean":"2024-04-26T12:13:25.556132+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:25.556132+0000","last_undegraded":"2024-04-26T12:13:25.556132+0000","last_fullsized":"2024-04-26T12:13:25.556132+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:48.553812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470936+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:26.470936+0000","last_peered":"2024-04-26T12:13:26.470936+0000","last_clean":"2024-04-26T12:13:26.470936+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:26.470936+0000","last_undegraded":"2024-04-26T12:13:26.470936+0000","last_fullsized":"2024-04-26T12:13:26.470936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":78,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.556493+0000","last_change":"2024-04-26T12:13:14.394918+0000","last_active":"2024-04-26T12:13:25.556493+0000","last_peered":"2024-04-26T12:13:25.556493+0000","last_clean":"2024-04-26T12:13:25.556493+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:25.556493+0000","last_undegraded":"2024-04-26T12:13:25.556493+0000","last_fullsized":"2024-04-26T12:13:25.556493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002812,"statfs":{"total":96636764160,"available":96258879488,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.55900000000000005}]}]},{"osd":0,"up_from":64,"seq":274877906949,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289228,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082612,"statfs":{"total":96636764160,"available":96340594688,"internally_reserved":0,"allocated":1376256,"data_stored":889844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Apr 26 12:12:49 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.76900000000000002,"5min":2.214,"15min":2.214},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.42499999999999999},"min":{"1min":0.19500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.8440000000000001,"5min":2.294,"15min":2.294},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:32.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:13:33.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:33.277 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":71,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:13:27.472666+0000","last_up_change":"2024-04-26T12:13:13.374165+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":64,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":5984},{"type":"v1","addr":"172.21.15.71:6801","nonce":5984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":5984},{"type":"v1","addr":"172.21.15.71:6803","nonce":5984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":5984},{"type":"v1","addr":"172.21.15.71:6807","nonce":5984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":5984},{"type":"v1","addr":"172.21.15.71:6805","nonce":5984}]},"public_addr":"172.21.15.71:6801/5984","cluster_addr":"172.21.15.71:6803/5984","heartbeat_back_addr":"172.21.15.71:6807/5984","heartbeat_front_addr":"172.21.15.71:6805/5984","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":29},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:13:34.294 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:13:34.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:13:34.467 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:13:34.467 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T12:13:34.467 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:13:34.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:13:34.848 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:13:34.861 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:13:34.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:13:35.026 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:13:35.026 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:13:35.027 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:13:35.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:13:35.406 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:13:35.419 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:13:35.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:13:35.583 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-04-26T12:13:35.584 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:13:35.584 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-04-26T12:13:35.597 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:13:35.965 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:13:35.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:36.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:36.348 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:36.360 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-26T12:13:34.923777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702392,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413128,"statfs":{"total":289910292480,"available":289191043072,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.454480"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471657+0000","last_change":"2024-04-26T12:09:49.371997+0000","last_active":"2024-04-26T12:13:26.471657+0000","last_peered":"2024-04-26T12:13:26.471657+0000","last_clean":"2024-04-26T12:13:26.471657+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:26.471657+0000","last_undegraded":"2024-04-26T12:13:26.471657+0000","last_fullsized":"2024-04-26T12:13:26.471657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:40.471886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470206+0000","last_change":"2024-04-26T12:13:14.393093+0000","last_active":"2024-04-26T12:13:25.470206+0000","last_peered":"2024-04-26T12:13:25.470206+0000","last_clean":"2024-04-26T12:13:25.470206+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:25.470206+0000","last_undegraded":"2024-04-26T12:13:25.470206+0000","last_fullsized":"2024-04-26T12:13:25.470206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:53.974372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469991+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:25.469991+0000","last_peered":"2024-04-26T12:13:25.469991+0000","last_clean":"2024-04-26T12:13:25.469991+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:25.469991+0000","last_undegraded":"2024-04-26T12:13:25.469991+0000","last_fullsized":"2024-04-26T12:13:25.469991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:57.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470786+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:26.470786+0000","last_peered":"2024-04-26T12:13:26.470786+0000","last_clean":"2024-04-26T12:13:26.470786+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:26.470786+0000","last_undegraded":"2024-04-26T12:13:26.470786+0000","last_fullsized":"2024-04-26T12:13:26.470786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469418+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:25.469418+0000","last_peered":"2024-04-26T12:13:25.469418+0000","last_clean":"2024-04-26T12:13:25.469418+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:25.469418+0000","last_undegraded":"2024-04-26T12:13:25.469418+0000","last_fullsized":"2024-04-26T12:13:25.469418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:21.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469383+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:25.469383+0000","last_peered":"2024-04-26T12:13:25.469383+0000","last_clean":"2024-04-26T12:13:25.469383+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:25.469383+0000","last_undegraded":"2024-04-26T12:13:25.469383+0000","last_fullsized":"2024-04-26T12:13:25.469383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:49.959427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469164+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:25.469164+0000","last_peered":"2024-04-26T12:13:25.469164+0000","last_clean":"2024-04-26T12:13:25.469164+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:25.469164+0000","last_undegraded":"2024-04-26T12:13:25.469164+0000","last_fullsized":"2024-04-26T12:13:25.469164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:03.771898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471091+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:26.471091+0000","last_peered":"2024-04-26T12:13:26.471091+0000","last_clean":"2024-04-26T12:13:26.471091+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:26.471091+0000","last_undegraded":"2024-04-26T12:13:26.471091+0000","last_fullsized":"2024-04-26T12:13:26.471091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471466+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:26.471466+0000","last_peered":"2024-04-26T12:13:26.471466+0000","last_clean":"2024-04-26T12:13:26.471466+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:26.471466+0000","last_undegraded":"2024-04-26T12:13:26.471466+0000","last_fullsized":"2024-04-26T12:13:26.471466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470312+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:25.470312+0000","last_peered":"2024-04-26T12:13:25.470312+0000","last_clean":"2024-04-26T12:13:25.470312+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:25.470312+0000","last_undegraded":"2024-04-26T12:13:25.470312+0000","last_fullsized":"2024-04-26T12:13:25.470312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:33.110932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471003+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:26.471003+0000","last_peered":"2024-04-26T12:13:26.471003+0000","last_clean":"2024-04-26T12:13:26.471003+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:26.471003+0000","last_undegraded":"2024-04-26T12:13:26.471003+0000","last_fullsized":"2024-04-26T12:13:26.471003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:29.958220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471027+0000","last_change":"2024-04-26T12:09:49.376594+0000","last_active":"2024-04-26T12:13:26.471027+0000","last_peered":"2024-04-26T12:13:26.471027+0000","last_clean":"2024-04-26T12:13:26.471027+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:26.471027+0000","last_undegraded":"2024-04-26T12:13:26.471027+0000","last_fullsized":"2024-04-26T12:13:26.471027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:29.498630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469707+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:25.469707+0000","last_peered":"2024-04-26T12:13:25.469707+0000","last_clean":"2024-04-26T12:13:25.469707+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:25.469707+0000","last_undegraded":"2024-04-26T12:13:25.469707+0000","last_fullsized":"2024-04-26T12:13:25.469707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:45.547385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469637+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:25.469637+0000","last_peered":"2024-04-26T12:13:25.469637+0000","last_clean":"2024-04-26T12:13:25.469637+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:25.469637+0000","last_undegraded":"2024-04-26T12:13:25.469637+0000","last_fullsized":"2024-04-26T12:13:25.469637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469513+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:25.469513+0000","last_peered":"2024-04-26T12:13:25.469513+0000","last_clean":"2024-04-26T12:13:25.469513+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:25.469513+0000","last_undegraded":"2024-04-26T12:13:25.469513+0000","last_fullsized":"2024-04-26T12:13:25.469513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:19.229847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471104+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:26.471104+0000","last_peered":"2024-04-26T12:13:26.471104+0000","last_clean":"2024-04-26T12:13:26.471104+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:26.471104+0000","last_undegraded":"2024-04-26T12:13:26.471104+0000","last_fullsized":"2024-04-26T12:13:26.471104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:41.536944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471414+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:26.471414+0000","last_peered":"2024-04-26T12:13:26.471414+0000","last_clean":"2024-04-26T12:13:26.471414+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:26.471414+0000","last_undegraded":"2024-04-26T12:13:26.471414+0000","last_fullsized":"2024-04-26T12:13:26.471414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:53.682832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470865+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:26.470865+0000","last_peered":"2024-04-26T12:13:26.470865+0000","last_clean":"2024-04-26T12:13:26.470865+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:26.470865+0000","last_undegraded":"2024-04-26T12:13:26.470865+0000","last_fullsized":"2024-04-26T12:13:26.470865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470090+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:25.470090+0000","last_peered":"2024-04-26T12:13:25.470090+0000","last_clean":"2024-04-26T12:13:25.470090+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:25.470090+0000","last_undegraded":"2024-04-26T12:13:25.470090+0000","last_fullsized":"2024-04-26T12:13:25.470090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:07.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469579+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:25.469579+0000","last_peered":"2024-04-26T12:13:25.469579+0000","last_clean":"2024-04-26T12:13:25.469579+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:25.469579+0000","last_undegraded":"2024-04-26T12:13:25.469579+0000","last_fullsized":"2024-04-26T12:13:25.469579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:49.995173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470757+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:26.470757+0000","last_peered":"2024-04-26T12:13:26.470757+0000","last_clean":"2024-04-26T12:13:26.470757+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:26.470757+0000","last_undegraded":"2024-04-26T12:13:26.470757+0000","last_fullsized":"2024-04-26T12:13:26.470757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:21.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470536+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:26.470536+0000","last_peered":"2024-04-26T12:13:26.470536+0000","last_clean":"2024-04-26T12:13:26.470536+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:26.470536+0000","last_undegraded":"2024-04-26T12:13:26.470536+0000","last_fullsized":"2024-04-26T12:13:26.470536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470797+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:26.470797+0000","last_peered":"2024-04-26T12:13:26.470797+0000","last_clean":"2024-04-26T12:13:26.470797+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:26.470797+0000","last_undegraded":"2024-04-26T12:13:26.470797+0000","last_fullsized":"2024-04-26T12:13:26.470797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471567+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:26.471567+0000","last_peered":"2024-04-26T12:13:26.471567+0000","last_clean":"2024-04-26T12:13:26.471567+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:26.471567+0000","last_undegraded":"2024-04-26T12:13:26.471567+0000","last_fullsized":"2024-04-26T12:13:26.471567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:04.826156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470956+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:26.470956+0000","last_peered":"2024-04-26T12:13:26.470956+0000","last_clean":"2024-04-26T12:13:26.470956+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:26.470956+0000","last_undegraded":"2024-04-26T12:13:26.470956+0000","last_fullsized":"2024-04-26T12:13:26.470956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:32.586178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470373+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:25.470373+0000","last_peered":"2024-04-26T12:13:25.470373+0000","last_clean":"2024-04-26T12:13:25.470373+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:25.470373+0000","last_undegraded":"2024-04-26T12:13:25.470373+0000","last_fullsized":"2024-04-26T12:13:25.470373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:43.755438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470620+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:26.470620+0000","last_peered":"2024-04-26T12:13:26.470620+0000","last_clean":"2024-04-26T12:13:26.470620+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:26.470620+0000","last_undegraded":"2024-04-26T12:13:26.470620+0000","last_fullsized":"2024-04-26T12:13:26.470620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:30.280980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470431+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:26.470431+0000","last_peered":"2024-04-26T12:13:26.470431+0000","last_clean":"2024-04-26T12:13:26.470431+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:26.470431+0000","last_undegraded":"2024-04-26T12:13:26.470431+0000","last_fullsized":"2024-04-26T12:13:26.470431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:33.775756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471084+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:26.471084+0000","last_peered":"2024-04-26T12:13:26.471084+0000","last_clean":"2024-04-26T12:13:26.471084+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:26.471084+0000","last_undegraded":"2024-04-26T12:13:26.471084+0000","last_fullsized":"2024-04-26T12:13:26.471084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.984438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470294+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:26.470294+0000","last_peered":"2024-04-26T12:13:26.470294+0000","last_clean":"2024-04-26T12:13:26.470294+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:26.470294+0000","last_undegraded":"2024-04-26T12:13:26.470294+0000","last_fullsized":"2024-04-26T12:13:26.470294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:41.854096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471567+0000","last_change":"2024-04-26T12:13:14.393885+0000","last_active":"2024-04-26T12:13:26.471567+0000","last_peered":"2024-04-26T12:13:26.471567+0000","last_clean":"2024-04-26T12:13:26.471567+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:26.471567+0000","last_undegraded":"2024-04-26T12:13:26.471567+0000","last_fullsized":"2024-04-26T12:13:26.471567+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:37.146713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471245+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:26.471245+0000","last_peered":"2024-04-26T12:13:26.471245+0000","last_clean":"2024-04-26T12:13:26.471245+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:26.471245+0000","last_undegraded":"2024-04-26T12:13:26.471245+0000","last_fullsized":"2024-04-26T12:13:26.471245+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:07.033491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470178+0000","last_change":"2024-04-26T12:09:49.379037+0000","last_active":"2024-04-26T12:13:26.470178+0000","last_peered":"2024-04-26T12:13:26.470178+0000","last_clean":"2024-04-26T12:13:26.470178+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:26.470178+0000","last_undegraded":"2024-04-26T12:13:26.470178+0000","last_fullsized":"2024-04-26T12:13:26.470178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:01.324327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470146+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:25.470146+0000","last_peered":"2024-04-26T12:13:25.470146+0000","last_clean":"2024-04-26T12:13:25.470146+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:25.470146+0000","last_undegraded":"2024-04-26T12:13:25.470146+0000","last_fullsized":"2024-04-26T12:13:25.470146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:08.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470437+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:26.470437+0000","last_peered":"2024-04-26T12:13:26.470437+0000","last_clean":"2024-04-26T12:13:26.470437+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:26.470437+0000","last_undegraded":"2024-04-26T12:13:26.470437+0000","last_fullsized":"2024-04-26T12:13:26.470437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:18.113884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471129+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:26.471129+0000","last_peered":"2024-04-26T12:13:26.471129+0000","last_clean":"2024-04-26T12:13:26.471129+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:26.471129+0000","last_undegraded":"2024-04-26T12:13:26.471129+0000","last_fullsized":"2024-04-26T12:13:26.471129+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:28.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470469+0000","last_change":"2024-04-26T12:09:49.379146+0000","last_active":"2024-04-26T12:13:26.470469+0000","last_peered":"2024-04-26T12:13:26.470469+0000","last_clean":"2024-04-26T12:13:26.470469+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:26.470469+0000","last_undegraded":"2024-04-26T12:13:26.470469+0000","last_fullsized":"2024-04-26T12:13:26.470469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.621025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":31,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470033+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:25.470033+0000","last_peered":"2024-04-26T12:13:25.470033+0000","last_clean":"2024-04-26T12:13:25.470033+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:25.470033+0000","last_undegraded":"2024-04-26T12:13:25.470033+0000","last_fullsized":"2024-04-26T12:13:25.470033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:36.499448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470004+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:25.470004+0000","last_peered":"2024-04-26T12:13:25.470004+0000","last_clean":"2024-04-26T12:13:25.470004+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:25.470004+0000","last_undegraded":"2024-04-26T12:13:25.470004+0000","last_fullsized":"2024-04-26T12:13:25.470004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:06.974259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469561+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:25.469561+0000","last_peered":"2024-04-26T12:13:25.469561+0000","last_clean":"2024-04-26T12:13:25.469561+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:25.469561+0000","last_undegraded":"2024-04-26T12:13:25.469561+0000","last_fullsized":"2024-04-26T12:13:25.469561+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.636439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470889+0000","last_change":"2024-04-26T12:09:49.375680+0000","last_active":"2024-04-26T12:13:26.470889+0000","last_peered":"2024-04-26T12:13:26.470889+0000","last_clean":"2024-04-26T12:13:26.470889+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:26.470889+0000","last_undegraded":"2024-04-26T12:13:26.470889+0000","last_fullsized":"2024-04-26T12:13:26.470889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:57.662101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470356+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:26.470356+0000","last_peered":"2024-04-26T12:13:26.470356+0000","last_clean":"2024-04-26T12:13:26.470356+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:26.470356+0000","last_undegraded":"2024-04-26T12:13:26.470356+0000","last_fullsized":"2024-04-26T12:13:26.470356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:34.040588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471351+0000","last_change":"2024-04-26T12:09:49.372426+0000","last_active":"2024-04-26T12:13:26.471351+0000","last_peered":"2024-04-26T12:13:26.471351+0000","last_clean":"2024-04-26T12:13:26.471351+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:26.471351+0000","last_undegraded":"2024-04-26T12:13:26.471351+0000","last_fullsized":"2024-04-26T12:13:26.471351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470697+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:26.470697+0000","last_peered":"2024-04-26T12:13:26.470697+0000","last_clean":"2024-04-26T12:13:26.470697+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:26.470697+0000","last_undegraded":"2024-04-26T12:13:26.470697+0000","last_fullsized":"2024-04-26T12:13:26.470697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:23.129074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471225+0000","last_change":"2024-04-26T12:13:14.392569+0000","last_active":"2024-04-26T12:13:26.471225+0000","last_peered":"2024-04-26T12:13:26.471225+0000","last_clean":"2024-04-26T12:13:26.471225+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:26.471225+0000","last_undegraded":"2024-04-26T12:13:26.471225+0000","last_fullsized":"2024-04-26T12:13:26.471225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":30,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469289+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:25.469289+0000","last_peered":"2024-04-26T12:13:25.469289+0000","last_clean":"2024-04-26T12:13:25.469289+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:25.469289+0000","last_undegraded":"2024-04-26T12:13:25.469289+0000","last_fullsized":"2024-04-26T12:13:25.469289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:07.348907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471306+0000","last_change":"2024-04-26T12:13:14.396669+0000","last_active":"2024-04-26T12:13:26.471306+0000","last_peered":"2024-04-26T12:13:26.471306+0000","last_clean":"2024-04-26T12:13:26.471306+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:26.471306+0000","last_undegraded":"2024-04-26T12:13:26.471306+0000","last_fullsized":"2024-04-26T12:13:26.471306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470330+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:25.470330+0000","last_peered":"2024-04-26T12:13:25.470330+0000","last_clean":"2024-04-26T12:13:25.470330+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:25.470330+0000","last_undegraded":"2024-04-26T12:13:25.470330+0000","last_fullsized":"2024-04-26T12:13:25.470330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.428330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470368+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:26.470368+0000","last_peered":"2024-04-26T12:13:26.470368+0000","last_clean":"2024-04-26T12:13:26.470368+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:26.470368+0000","last_undegraded":"2024-04-26T12:13:26.470368+0000","last_fullsized":"2024-04-26T12:13:26.470368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:44.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471270+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:26.471270+0000","last_peered":"2024-04-26T12:13:26.471270+0000","last_clean":"2024-04-26T12:13:26.471270+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:26.471270+0000","last_undegraded":"2024-04-26T12:13:26.471270+0000","last_fullsized":"2024-04-26T12:13:26.471270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.186277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470910+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:26.470910+0000","last_peered":"2024-04-26T12:13:26.470910+0000","last_clean":"2024-04-26T12:13:26.470910+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:26.470910+0000","last_undegraded":"2024-04-26T12:13:26.470910+0000","last_fullsized":"2024-04-26T12:13:26.470910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:04.900522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469954+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:25.469954+0000","last_peered":"2024-04-26T12:13:25.469954+0000","last_clean":"2024-04-26T12:13:25.469954+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:25.469954+0000","last_undegraded":"2024-04-26T12:13:25.469954+0000","last_fullsized":"2024-04-26T12:13:25.469954+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:29.651436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469598+0000","last_change":"2024-04-26T12:13:14.392806+0000","last_active":"2024-04-26T12:13:25.469598+0000","last_peered":"2024-04-26T12:13:25.469598+0000","last_clean":"2024-04-26T12:13:25.469598+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:25.469598+0000","last_undegraded":"2024-04-26T12:13:25.469598+0000","last_fullsized":"2024-04-26T12:13:25.469598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:27.472246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470144+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:25.470144+0000","last_peered":"2024-04-26T12:13:25.470144+0000","last_clean":"2024-04-26T12:13:25.470144+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:25.470144+0000","last_undegraded":"2024-04-26T12:13:25.470144+0000","last_fullsized":"2024-04-26T12:13:25.470144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:43.465677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470638+0000","last_change":"2024-04-26T12:13:14.396914+0000","last_active":"2024-04-26T12:13:26.470638+0000","last_peered":"2024-04-26T12:13:26.470638+0000","last_clean":"2024-04-26T12:13:26.470638+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:26.470638+0000","last_undegraded":"2024-04-26T12:13:26.470638+0000","last_fullsized":"2024-04-26T12:13:26.470638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:33.086082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470602+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:26.470602+0000","last_peered":"2024-04-26T12:13:26.470602+0000","last_clean":"2024-04-26T12:13:26.470602+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:26.470602+0000","last_undegraded":"2024-04-26T12:13:26.470602+0000","last_fullsized":"2024-04-26T12:13:26.470602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:42.180071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469889+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:25.469889+0000","last_peered":"2024-04-26T12:13:25.469889+0000","last_clean":"2024-04-26T12:13:25.469889+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:25.469889+0000","last_undegraded":"2024-04-26T12:13:25.469889+0000","last_fullsized":"2024-04-26T12:13:25.469889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:16.727025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469510+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:25.469510+0000","last_peered":"2024-04-26T12:13:25.469510+0000","last_clean":"2024-04-26T12:13:25.469510+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:25.469510+0000","last_undegraded":"2024-04-26T12:13:25.469510+0000","last_fullsized":"2024-04-26T12:13:25.469510+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:39.928988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470349+0000","last_change":"2024-04-26T12:13:14.394506+0000","last_active":"2024-04-26T12:13:25.470349+0000","last_peered":"2024-04-26T12:13:25.470349+0000","last_clean":"2024-04-26T12:13:25.470349+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:25.470349+0000","last_undegraded":"2024-04-26T12:13:25.470349+0000","last_fullsized":"2024-04-26T12:13:25.470349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:14.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470549+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:26.470549+0000","last_peered":"2024-04-26T12:13:26.470549+0000","last_clean":"2024-04-26T12:13:26.470549+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:26.470549+0000","last_undegraded":"2024-04-26T12:13:26.470549+0000","last_fullsized":"2024-04-26T12:13:26.470549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:24.717066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470241+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:25.470241+0000","last_peered":"2024-04-26T12:13:25.470241+0000","last_clean":"2024-04-26T12:13:25.470241+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:25.470241+0000","last_undegraded":"2024-04-26T12:13:25.470241+0000","last_fullsized":"2024-04-26T12:13:25.470241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:48.951351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470654+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:26.470654+0000","last_peered":"2024-04-26T12:13:26.470654+0000","last_clean":"2024-04-26T12:13:26.470654+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:26.470654+0000","last_undegraded":"2024-04-26T12:13:26.470654+0000","last_fullsized":"2024-04-26T12:13:26.470654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471174+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:26.471174+0000","last_peered":"2024-04-26T12:13:26.471174+0000","last_clean":"2024-04-26T12:13:26.471174+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:26.471174+0000","last_undegraded":"2024-04-26T12:13:26.471174+0000","last_fullsized":"2024-04-26T12:13:26.471174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.321294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471166+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:26.471166+0000","last_peered":"2024-04-26T12:13:26.471166+0000","last_clean":"2024-04-26T12:13:26.471166+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:26.471166+0000","last_undegraded":"2024-04-26T12:13:26.471166+0000","last_fullsized":"2024-04-26T12:13:26.471166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:57.975618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471205+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:26.471205+0000","last_peered":"2024-04-26T12:13:26.471205+0000","last_clean":"2024-04-26T12:13:26.471205+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:26.471205+0000","last_undegraded":"2024-04-26T12:13:26.471205+0000","last_fullsized":"2024-04-26T12:13:26.471205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:12.478096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470220+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:26.470220+0000","last_peered":"2024-04-26T12:13:26.470220+0000","last_clean":"2024-04-26T12:13:26.470220+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:26.470220+0000","last_undegraded":"2024-04-26T12:13:26.470220+0000","last_fullsized":"2024-04-26T12:13:26.470220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:31.826247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471011+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:26.471011+0000","last_peered":"2024-04-26T12:13:26.471011+0000","last_clean":"2024-04-26T12:13:26.471011+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:26.471011+0000","last_undegraded":"2024-04-26T12:13:26.471011+0000","last_fullsized":"2024-04-26T12:13:26.471011+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:45.968725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471078+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:26.471078+0000","last_peered":"2024-04-26T12:13:26.471078+0000","last_clean":"2024-04-26T12:13:26.471078+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:26.471078+0000","last_undegraded":"2024-04-26T12:13:26.471078+0000","last_fullsized":"2024-04-26T12:13:26.471078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:01.844315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470857+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:26.470857+0000","last_peered":"2024-04-26T12:13:26.470857+0000","last_clean":"2024-04-26T12:13:26.470857+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:26.470857+0000","last_undegraded":"2024-04-26T12:13:26.470857+0000","last_fullsized":"2024-04-26T12:13:26.470857+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:52.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470700+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:26.470700+0000","last_peered":"2024-04-26T12:13:26.470700+0000","last_clean":"2024-04-26T12:13:26.470700+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:26.470700+0000","last_undegraded":"2024-04-26T12:13:26.470700+0000","last_fullsized":"2024-04-26T12:13:26.470700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:19.540441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":220,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469243+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:25.469243+0000","last_peered":"2024-04-26T12:13:25.469243+0000","last_clean":"2024-04-26T12:13:25.469243+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:25.469243+0000","last_undegraded":"2024-04-26T12:13:25.469243+0000","last_fullsized":"2024-04-26T12:13:25.469243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:35.149994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470231+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:26.470231+0000","last_peered":"2024-04-26T12:13:26.470231+0000","last_clean":"2024-04-26T12:13:26.470231+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:26.470231+0000","last_undegraded":"2024-04-26T12:13:26.470231+0000","last_fullsized":"2024-04-26T12:13:26.470231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:51.595471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471516+0000","last_change":"2024-04-26T12:09:49.373357+0000","last_active":"2024-04-26T12:13:26.471516+0000","last_peered":"2024-04-26T12:13:26.471516+0000","last_clean":"2024-04-26T12:13:26.471516+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:26.471516+0000","last_undegraded":"2024-04-26T12:13:26.471516+0000","last_fullsized":"2024-04-26T12:13:26.471516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:12.984690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469686+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:25.469686+0000","last_peered":"2024-04-26T12:13:25.469686+0000","last_clean":"2024-04-26T12:13:25.469686+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:25.469686+0000","last_undegraded":"2024-04-26T12:13:25.469686+0000","last_fullsized":"2024-04-26T12:13:25.469686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:46.093761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470488+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:26.470488+0000","last_peered":"2024-04-26T12:13:26.470488+0000","last_clean":"2024-04-26T12:13:26.470488+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:26.470488+0000","last_undegraded":"2024-04-26T12:13:26.470488+0000","last_fullsized":"2024-04-26T12:13:26.470488+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:22.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471301+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:26.471301+0000","last_peered":"2024-04-26T12:13:26.471301+0000","last_clean":"2024-04-26T12:13:26.471301+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:26.471301+0000","last_undegraded":"2024-04-26T12:13:26.471301+0000","last_fullsized":"2024-04-26T12:13:26.471301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:10.912046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469453+0000","last_change":"2024-04-26T12:13:14.392269+0000","last_active":"2024-04-26T12:13:25.469453+0000","last_peered":"2024-04-26T12:13:25.469453+0000","last_clean":"2024-04-26T12:13:25.469453+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:25.469453+0000","last_undegraded":"2024-04-26T12:13:25.469453+0000","last_fullsized":"2024-04-26T12:13:25.469453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:55.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470399+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:26.470399+0000","last_peered":"2024-04-26T12:13:26.470399+0000","last_clean":"2024-04-26T12:13:26.470399+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:26.470399+0000","last_undegraded":"2024-04-26T12:13:26.470399+0000","last_fullsized":"2024-04-26T12:13:26.470399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.770654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470084+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:25.470084+0000","last_peered":"2024-04-26T12:13:25.470084+0000","last_clean":"2024-04-26T12:13:25.470084+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:25.470084+0000","last_undegraded":"2024-04-26T12:13:25.470084+0000","last_fullsized":"2024-04-26T12:13:25.470084+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:24.319975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470606+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:26.470606+0000","last_peered":"2024-04-26T12:13:26.470606+0000","last_clean":"2024-04-26T12:13:26.470606+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:26.470606+0000","last_undegraded":"2024-04-26T12:13:26.470606+0000","last_fullsized":"2024-04-26T12:13:26.470606+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:38.877528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469673+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:25.469673+0000","last_peered":"2024-04-26T12:13:25.469673+0000","last_clean":"2024-04-26T12:13:25.469673+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:25.469673+0000","last_undegraded":"2024-04-26T12:13:25.469673+0000","last_fullsized":"2024-04-26T12:13:25.469673+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:03.736741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470868+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:26.470868+0000","last_peered":"2024-04-26T12:13:26.470868+0000","last_clean":"2024-04-26T12:13:26.470868+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:26.470868+0000","last_undegraded":"2024-04-26T12:13:26.470868+0000","last_fullsized":"2024-04-26T12:13:26.470868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:27.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471385+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:26.471385+0000","last_peered":"2024-04-26T12:13:26.471385+0000","last_clean":"2024-04-26T12:13:26.471385+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:26.471385+0000","last_undegraded":"2024-04-26T12:13:26.471385+0000","last_fullsized":"2024-04-26T12:13:26.471385+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:57.924425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470966+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:26.470966+0000","last_peered":"2024-04-26T12:13:26.470966+0000","last_clean":"2024-04-26T12:13:26.470966+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:26.470966+0000","last_undegraded":"2024-04-26T12:13:26.470966+0000","last_fullsized":"2024-04-26T12:13:26.470966+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:14.549429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470781+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:26.470781+0000","last_peered":"2024-04-26T12:13:26.470781+0000","last_clean":"2024-04-26T12:13:26.470781+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:26.470781+0000","last_undegraded":"2024-04-26T12:13:26.470781+0000","last_fullsized":"2024-04-26T12:13:26.470781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:42.133925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470035+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:25.470035+0000","last_peered":"2024-04-26T12:13:25.470035+0000","last_clean":"2024-04-26T12:13:25.470035+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:25.470035+0000","last_undegraded":"2024-04-26T12:13:25.470035+0000","last_fullsized":"2024-04-26T12:13:25.470035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:17.507288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.470195+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:25.470195+0000","last_peered":"2024-04-26T12:13:25.470195+0000","last_clean":"2024-04-26T12:13:25.470195+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:25.470195+0000","last_undegraded":"2024-04-26T12:13:25.470195+0000","last_fullsized":"2024-04-26T12:13:25.470195+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:30.589803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470764+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:26.470764+0000","last_peered":"2024-04-26T12:13:26.470764+0000","last_clean":"2024-04-26T12:13:26.470764+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:26.470764+0000","last_undegraded":"2024-04-26T12:13:26.470764+0000","last_fullsized":"2024-04-26T12:13:26.470764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470925+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:26.470925+0000","last_peered":"2024-04-26T12:13:26.470925+0000","last_clean":"2024-04-26T12:13:26.470925+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:26.470925+0000","last_undegraded":"2024-04-26T12:13:26.470925+0000","last_fullsized":"2024-04-26T12:13:26.470925+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471136+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:26.471136+0000","last_peered":"2024-04-26T12:13:26.471136+0000","last_clean":"2024-04-26T12:13:26.471136+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:26.471136+0000","last_undegraded":"2024-04-26T12:13:26.471136+0000","last_fullsized":"2024-04-26T12:13:26.471136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469843+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:25.469843+0000","last_peered":"2024-04-26T12:13:25.469843+0000","last_clean":"2024-04-26T12:13:25.469843+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:25.469843+0000","last_undegraded":"2024-04-26T12:13:25.469843+0000","last_fullsized":"2024-04-26T12:13:25.469843+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.214997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469946+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:25.469946+0000","last_peered":"2024-04-26T12:13:25.469946+0000","last_clean":"2024-04-26T12:13:25.469946+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:25.469946+0000","last_undegraded":"2024-04-26T12:13:25.469946+0000","last_fullsized":"2024-04-26T12:13:25.469946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:11.878980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":35,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469967+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:25.469967+0000","last_peered":"2024-04-26T12:13:25.469967+0000","last_clean":"2024-04-26T12:13:25.469967+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:25.469967+0000","last_undegraded":"2024-04-26T12:13:25.469967+0000","last_fullsized":"2024-04-26T12:13:25.469967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:33.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469576+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:25.469576+0000","last_peered":"2024-04-26T12:13:25.469576+0000","last_clean":"2024-04-26T12:13:25.469576+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:25.469576+0000","last_undegraded":"2024-04-26T12:13:25.469576+0000","last_fullsized":"2024-04-26T12:13:25.469576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:25.810626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471000+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:26.471000+0000","last_peered":"2024-04-26T12:13:26.471000+0000","last_clean":"2024-04-26T12:13:26.471000+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:26.471000+0000","last_undegraded":"2024-04-26T12:13:26.471000+0000","last_fullsized":"2024-04-26T12:13:26.471000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:07.342420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470961+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:26.470961+0000","last_peered":"2024-04-26T12:13:26.470961+0000","last_clean":"2024-04-26T12:13:26.470961+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:26.470961+0000","last_undegraded":"2024-04-26T12:13:26.470961+0000","last_fullsized":"2024-04-26T12:13:26.470961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:43.365902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471249+0000","last_change":"2024-04-26T12:13:14.396440+0000","last_active":"2024-04-26T12:13:26.471249+0000","last_peered":"2024-04-26T12:13:26.471249+0000","last_clean":"2024-04-26T12:13:26.471249+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:26.471249+0000","last_undegraded":"2024-04-26T12:13:26.471249+0000","last_fullsized":"2024-04-26T12:13:26.471249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:57.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469405+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:25.469405+0000","last_peered":"2024-04-26T12:13:25.469405+0000","last_clean":"2024-04-26T12:13:25.469405+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:25.469405+0000","last_undegraded":"2024-04-26T12:13:25.469405+0000","last_fullsized":"2024-04-26T12:13:25.469405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:25.593914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T12:13:25.469336+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:25.469336+0000","last_peered":"2024-04-26T12:13:25.469336+0000","last_clean":"2024-04-26T12:13:25.469336+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:25.469336+0000","last_undegraded":"2024-04-26T12:13:25.469336+0000","last_fullsized":"2024-04-26T12:13:25.469336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470322+0000","last_change":"2024-04-26T12:09:49.378557+0000","last_active":"2024-04-26T12:13:26.470322+0000","last_peered":"2024-04-26T12:13:26.470322+0000","last_clean":"2024-04-26T12:13:26.470322+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:26.470322+0000","last_undegraded":"2024-04-26T12:13:26.470322+0000","last_fullsized":"2024-04-26T12:13:26.470322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:02.922516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470916+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:26.470916+0000","last_peered":"2024-04-26T12:13:26.470916+0000","last_clean":"2024-04-26T12:13:26.470916+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:26.470916+0000","last_undegraded":"2024-04-26T12:13:26.470916+0000","last_fullsized":"2024-04-26T12:13:26.470916+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:48.553812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.470936+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:26.470936+0000","last_peered":"2024-04-26T12:13:26.470936+0000","last_clean":"2024-04-26T12:13:26.470936+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:26.470936+0000","last_undegraded":"2024-04-26T12:13:26.470936+0000","last_fullsized":"2024-04-26T12:13:26.470936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:20.753322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":79,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T12:13:26.471183+0000","last_change":"2024-04-26T12:13:14.394918+0000","last_active":"2024-04-26T12:13:26.471183+0000","last_peered":"2024-04-26T12:13:26.471183+0000","last_clean":"2024-04-26T12:13:26.471183+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:26.471183+0000","last_undegraded":"2024-04-26T12:13:26.471183+0000","last_fullsized":"2024-04-26T12:13:26.471183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.345450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738417,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002812,"statfs":{"total":96636764160,"available":96258879488,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.439},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.41099999999999998}]}]},{"osd":0,"up_from":64,"seq":274877906950,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289236,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082604,"statfs":{"total":96636764160,"available":96340586496,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:12:49 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.432,"15min":0.40799999999999997},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.76900000000000002,"5min":2.214,"15min":2.214},"last":0.436},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.48299999999999998,"15min":0.42499999999999999},"min":{"1min":0.19500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":1.8440000000000001,"5min":2.294,"15min":2.294},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:36.367 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.367 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.368 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.369 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.370 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.371 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.372 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.373 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.374 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.375 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:09:43.900793+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.376 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.377 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.378 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.379 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.379 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.379 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.379 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.379 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:36.379 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:13:56.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:13:56.760 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:13:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:13:56.774 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-26T12:13:54.928716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003226"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895316+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895316+0000","last_peered":"2024-04-26T12:13:40.895316+0000","last_clean":"2024-04-26T12:13:40.895316+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895316+0000","last_undegraded":"2024-04-26T12:13:40.895316+0000","last_fullsized":"2024-04-26T12:13:40.895316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832193+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:28.832193+0000","last_peered":"2024-04-26T12:13:28.832193+0000","last_clean":"2024-04-26T12:13:28.832193+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:28.832193+0000","last_undegraded":"2024-04-26T12:13:28.832193+0000","last_fullsized":"2024-04-26T12:13:28.832193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900330+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900330+0000","last_peered":"2024-04-26T12:13:39.900330+0000","last_clean":"2024-04-26T12:13:39.900330+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900330+0000","last_undegraded":"2024-04-26T12:13:39.900330+0000","last_fullsized":"2024-04-26T12:13:39.900330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478159+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:27.478159+0000","last_peered":"2024-04-26T12:13:27.478159+0000","last_clean":"2024-04-26T12:13:27.478159+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:27.478159+0000","last_undegraded":"2024-04-26T12:13:27.478159+0000","last_fullsized":"2024-04-26T12:13:27.478159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831507+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:28.831507+0000","last_peered":"2024-04-26T12:13:28.831507+0000","last_clean":"2024-04-26T12:13:28.831507+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:28.831507+0000","last_undegraded":"2024-04-26T12:13:28.831507+0000","last_fullsized":"2024-04-26T12:13:28.831507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477196+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:27.477196+0000","last_peered":"2024-04-26T12:13:27.477196+0000","last_clean":"2024-04-26T12:13:27.477196+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:27.477196+0000","last_undegraded":"2024-04-26T12:13:27.477196+0000","last_fullsized":"2024-04-26T12:13:27.477196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477296+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:27.477296+0000","last_peered":"2024-04-26T12:13:27.477296+0000","last_clean":"2024-04-26T12:13:27.477296+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:27.477296+0000","last_undegraded":"2024-04-26T12:13:27.477296+0000","last_fullsized":"2024-04-26T12:13:27.477296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476972+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:27.476972+0000","last_peered":"2024-04-26T12:13:27.476972+0000","last_clean":"2024-04-26T12:13:27.476972+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:27.476972+0000","last_undegraded":"2024-04-26T12:13:27.476972+0000","last_fullsized":"2024-04-26T12:13:27.476972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476738+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:27.476738+0000","last_peered":"2024-04-26T12:13:27.476738+0000","last_clean":"2024-04-26T12:13:27.476738+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:27.476738+0000","last_undegraded":"2024-04-26T12:13:27.476738+0000","last_fullsized":"2024-04-26T12:13:27.476738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832350+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:28.832350+0000","last_peered":"2024-04-26T12:13:28.832350+0000","last_clean":"2024-04-26T12:13:28.832350+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:28.832350+0000","last_undegraded":"2024-04-26T12:13:28.832350+0000","last_fullsized":"2024-04-26T12:13:28.832350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478599+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:27.478599+0000","last_peered":"2024-04-26T12:13:27.478599+0000","last_clean":"2024-04-26T12:13:27.478599+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:27.478599+0000","last_undegraded":"2024-04-26T12:13:27.478599+0000","last_fullsized":"2024-04-26T12:13:27.478599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831871+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:28.831871+0000","last_peered":"2024-04-26T12:13:28.831871+0000","last_clean":"2024-04-26T12:13:28.831871+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:28.831871+0000","last_undegraded":"2024-04-26T12:13:28.831871+0000","last_fullsized":"2024-04-26T12:13:28.831871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768118+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768118+0000","last_peered":"2024-04-26T12:13:37.768118+0000","last_clean":"2024-04-26T12:13:37.768118+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768118+0000","last_undegraded":"2024-04-26T12:13:37.768118+0000","last_fullsized":"2024-04-26T12:13:37.768118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477835+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:27.477835+0000","last_peered":"2024-04-26T12:13:27.477835+0000","last_clean":"2024-04-26T12:13:27.477835+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:27.477835+0000","last_undegraded":"2024-04-26T12:13:27.477835+0000","last_fullsized":"2024-04-26T12:13:27.477835+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477719+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:27.477719+0000","last_peered":"2024-04-26T12:13:27.477719+0000","last_clean":"2024-04-26T12:13:27.477719+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:27.477719+0000","last_undegraded":"2024-04-26T12:13:27.477719+0000","last_fullsized":"2024-04-26T12:13:27.477719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477665+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:27.477665+0000","last_peered":"2024-04-26T12:13:27.477665+0000","last_clean":"2024-04-26T12:13:27.477665+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:27.477665+0000","last_undegraded":"2024-04-26T12:13:27.477665+0000","last_fullsized":"2024-04-26T12:13:27.477665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476773+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:27.476773+0000","last_peered":"2024-04-26T12:13:27.476773+0000","last_clean":"2024-04-26T12:13:27.476773+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:27.476773+0000","last_undegraded":"2024-04-26T12:13:27.476773+0000","last_fullsized":"2024-04-26T12:13:27.476773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832319+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:28.832319+0000","last_peered":"2024-04-26T12:13:28.832319+0000","last_clean":"2024-04-26T12:13:28.832319+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:28.832319+0000","last_undegraded":"2024-04-26T12:13:28.832319+0000","last_fullsized":"2024-04-26T12:13:28.832319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476586+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:27.476586+0000","last_peered":"2024-04-26T12:13:27.476586+0000","last_clean":"2024-04-26T12:13:27.476586+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:27.476586+0000","last_undegraded":"2024-04-26T12:13:27.476586+0000","last_fullsized":"2024-04-26T12:13:27.476586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478343+0000","last_change":"2024-04-26T12:13:14.393265+0000","last_active":"2024-04-26T12:13:27.478343+0000","last_peered":"2024-04-26T12:13:27.478343+0000","last_clean":"2024-04-26T12:13:27.478343+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:13:27.478343+0000","last_undegraded":"2024-04-26T12:13:27.478343+0000","last_fullsized":"2024-04-26T12:13:27.478343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477350+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:27.477350+0000","last_peered":"2024-04-26T12:13:27.477350+0000","last_clean":"2024-04-26T12:13:27.477350+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:27.477350+0000","last_undegraded":"2024-04-26T12:13:27.477350+0000","last_fullsized":"2024-04-26T12:13:27.477350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831662+0000","last_change":"2024-04-26T12:13:14.393513+0000","last_active":"2024-04-26T12:13:28.831662+0000","last_peered":"2024-04-26T12:13:28.831662+0000","last_clean":"2024-04-26T12:13:28.831662+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:28.831662+0000","last_undegraded":"2024-04-26T12:13:28.831662+0000","last_fullsized":"2024-04-26T12:13:28.831662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476439+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:27.476439+0000","last_peered":"2024-04-26T12:13:27.476439+0000","last_clean":"2024-04-26T12:13:27.476439+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:27.476439+0000","last_undegraded":"2024-04-26T12:13:27.476439+0000","last_fullsized":"2024-04-26T12:13:27.476439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831633+0000","last_change":"2024-04-26T12:09:49.373265+0000","last_active":"2024-04-26T12:13:28.831633+0000","last_peered":"2024-04-26T12:13:28.831633+0000","last_clean":"2024-04-26T12:13:28.831633+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:13:28.831633+0000","last_undegraded":"2024-04-26T12:13:28.831633+0000","last_fullsized":"2024-04-26T12:13:28.831633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832448+0000","last_change":"2024-04-26T12:13:14.394882+0000","last_active":"2024-04-26T12:13:28.832448+0000","last_peered":"2024-04-26T12:13:28.832448+0000","last_clean":"2024-04-26T12:13:28.832448+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:13:28.832448+0000","last_undegraded":"2024-04-26T12:13:28.832448+0000","last_fullsized":"2024-04-26T12:13:28.832448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476636+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:27.476636+0000","last_peered":"2024-04-26T12:13:27.476636+0000","last_clean":"2024-04-26T12:13:27.476636+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:27.476636+0000","last_undegraded":"2024-04-26T12:13:27.476636+0000","last_fullsized":"2024-04-26T12:13:27.476636+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478701+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:27.478701+0000","last_peered":"2024-04-26T12:13:27.478701+0000","last_clean":"2024-04-26T12:13:27.478701+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:27.478701+0000","last_undegraded":"2024-04-26T12:13:27.478701+0000","last_fullsized":"2024-04-26T12:13:27.478701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831629+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:28.831629+0000","last_peered":"2024-04-26T12:13:28.831629+0000","last_clean":"2024-04-26T12:13:28.831629+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:28.831629+0000","last_undegraded":"2024-04-26T12:13:28.831629+0000","last_fullsized":"2024-04-26T12:13:28.831629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832136+0000","last_change":"2024-04-26T12:13:14.397571+0000","last_active":"2024-04-26T12:13:28.832136+0000","last_peered":"2024-04-26T12:13:28.832136+0000","last_clean":"2024-04-26T12:13:28.832136+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:28.832136+0000","last_undegraded":"2024-04-26T12:13:28.832136+0000","last_fullsized":"2024-04-26T12:13:28.832136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476329+0000","last_change":"2024-04-26T12:13:14.391043+0000","last_active":"2024-04-26T12:13:27.476329+0000","last_peered":"2024-04-26T12:13:27.476329+0000","last_clean":"2024-04-26T12:13:27.476329+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:27.476329+0000","last_undegraded":"2024-04-26T12:13:27.476329+0000","last_fullsized":"2024-04-26T12:13:27.476329+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962136+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:35.962136+0000","last_peered":"2024-04-26T12:13:35.962136+0000","last_clean":"2024-04-26T12:13:35.962136+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:35.962136+0000","last_undegraded":"2024-04-26T12:13:35.962136+0000","last_fullsized":"2024-04-26T12:13:35.962136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476059+0000","last_change":"2024-04-26T12:09:48.930782+0000","last_active":"2024-04-26T12:13:27.476059+0000","last_peered":"2024-04-26T12:13:27.476059+0000","last_clean":"2024-04-26T12:13:27.476059+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:13:27.476059+0000","last_undegraded":"2024-04-26T12:13:27.476059+0000","last_fullsized":"2024-04-26T12:13:27.476059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.972932+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.972932+0000","last_peered":"2024-04-26T12:13:46.972932+0000","last_clean":"2024-04-26T12:13:46.972932+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.972932+0000","last_undegraded":"2024-04-26T12:13:46.972932+0000","last_fullsized":"2024-04-26T12:13:46.972932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476986+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:27.476986+0000","last_peered":"2024-04-26T12:13:27.476986+0000","last_clean":"2024-04-26T12:13:27.476986+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:27.476986+0000","last_undegraded":"2024-04-26T12:13:27.476986+0000","last_fullsized":"2024-04-26T12:13:27.476986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448430+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448430+0000","last_peered":"2024-04-26T12:13:40.448430+0000","last_clean":"2024-04-26T12:13:40.448430+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448430+0000","last_undegraded":"2024-04-26T12:13:40.448430+0000","last_fullsized":"2024-04-26T12:13:40.448430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478300+0000","last_change":"2024-04-26T12:13:14.389606+0000","last_active":"2024-04-26T12:13:27.478300+0000","last_peered":"2024-04-26T12:13:27.478300+0000","last_clean":"2024-04-26T12:13:27.478300+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:13:27.478300+0000","last_undegraded":"2024-04-26T12:13:27.478300+0000","last_fullsized":"2024-04-26T12:13:27.478300+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476257+0000","last_change":"2024-04-26T12:13:14.390809+0000","last_active":"2024-04-26T12:13:27.476257+0000","last_peered":"2024-04-26T12:13:27.476257+0000","last_clean":"2024-04-26T12:13:27.476257+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:27.476257+0000","last_undegraded":"2024-04-26T12:13:27.476257+0000","last_fullsized":"2024-04-26T12:13:27.476257+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832122+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:28.832122+0000","last_peered":"2024-04-26T12:13:28.832122+0000","last_clean":"2024-04-26T12:13:28.832122+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:28.832122+0000","last_undegraded":"2024-04-26T12:13:28.832122+0000","last_fullsized":"2024-04-26T12:13:28.832122+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448224+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448224+0000","last_peered":"2024-04-26T12:13:38.448224+0000","last_clean":"2024-04-26T12:13:38.448224+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448224+0000","last_undegraded":"2024-04-26T12:13:38.448224+0000","last_fullsized":"2024-04-26T12:13:38.448224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478313+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:27.478313+0000","last_peered":"2024-04-26T12:13:27.478313+0000","last_clean":"2024-04-26T12:13:27.478313+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:27.478313+0000","last_undegraded":"2024-04-26T12:13:27.478313+0000","last_fullsized":"2024-04-26T12:13:27.478313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477609+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:27.477609+0000","last_peered":"2024-04-26T12:13:27.477609+0000","last_clean":"2024-04-26T12:13:27.477609+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:27.477609+0000","last_undegraded":"2024-04-26T12:13:27.477609+0000","last_fullsized":"2024-04-26T12:13:27.477609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863557+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863557+0000","last_peered":"2024-04-26T12:13:43.863557+0000","last_clean":"2024-04-26T12:13:43.863557+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863557+0000","last_undegraded":"2024-04-26T12:13:43.863557+0000","last_fullsized":"2024-04-26T12:13:43.863557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476173+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:27.476173+0000","last_peered":"2024-04-26T12:13:27.476173+0000","last_clean":"2024-04-26T12:13:27.476173+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:27.476173+0000","last_undegraded":"2024-04-26T12:13:27.476173+0000","last_fullsized":"2024-04-26T12:13:27.476173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916371+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916371+0000","last_peered":"2024-04-26T12:13:45.916371+0000","last_clean":"2024-04-26T12:13:45.916371+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916371+0000","last_undegraded":"2024-04-26T12:13:45.916371+0000","last_fullsized":"2024-04-26T12:13:45.916371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831484+0000","last_change":"2024-04-26T12:13:14.393239+0000","last_active":"2024-04-26T12:13:28.831484+0000","last_peered":"2024-04-26T12:13:28.831484+0000","last_clean":"2024-04-26T12:13:28.831484+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:13:28.831484+0000","last_undegraded":"2024-04-26T12:13:28.831484+0000","last_fullsized":"2024-04-26T12:13:28.831484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433233+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433233+0000","last_peered":"2024-04-26T12:13:46.433233+0000","last_clean":"2024-04-26T12:13:46.433233+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433233+0000","last_undegraded":"2024-04-26T12:13:46.433233+0000","last_fullsized":"2024-04-26T12:13:46.433233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":31,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477218+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:27.477218+0000","last_peered":"2024-04-26T12:13:27.477218+0000","last_clean":"2024-04-26T12:13:27.477218+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:27.477218+0000","last_undegraded":"2024-04-26T12:13:27.477218+0000","last_fullsized":"2024-04-26T12:13:27.477218+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433025+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433025+0000","last_peered":"2024-04-26T12:13:48.433025+0000","last_clean":"2024-04-26T12:13:48.433025+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433025+0000","last_undegraded":"2024-04-26T12:13:48.433025+0000","last_fullsized":"2024-04-26T12:13:48.433025+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478494+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:27.478494+0000","last_peered":"2024-04-26T12:13:27.478494+0000","last_clean":"2024-04-26T12:13:27.478494+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:27.478494+0000","last_undegraded":"2024-04-26T12:13:27.478494+0000","last_fullsized":"2024-04-26T12:13:27.478494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831268+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:28.831268+0000","last_peered":"2024-04-26T12:13:28.831268+0000","last_clean":"2024-04-26T12:13:28.831268+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:28.831268+0000","last_undegraded":"2024-04-26T12:13:28.831268+0000","last_fullsized":"2024-04-26T12:13:28.831268+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832187+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:28.832187+0000","last_peered":"2024-04-26T12:13:28.832187+0000","last_clean":"2024-04-26T12:13:28.832187+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:28.832187+0000","last_undegraded":"2024-04-26T12:13:28.832187+0000","last_fullsized":"2024-04-26T12:13:28.832187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831662+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:28.831662+0000","last_peered":"2024-04-26T12:13:28.831662+0000","last_clean":"2024-04-26T12:13:28.831662+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:28.831662+0000","last_undegraded":"2024-04-26T12:13:28.831662+0000","last_fullsized":"2024-04-26T12:13:28.831662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478215+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:27.478215+0000","last_peered":"2024-04-26T12:13:27.478215+0000","last_clean":"2024-04-26T12:13:27.478215+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:27.478215+0000","last_undegraded":"2024-04-26T12:13:27.478215+0000","last_fullsized":"2024-04-26T12:13:27.478215+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879050+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879050+0000","last_peered":"2024-04-26T12:13:47.879050+0000","last_clean":"2024-04-26T12:13:47.879050+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879050+0000","last_undegraded":"2024-04-26T12:13:47.879050+0000","last_fullsized":"2024-04-26T12:13:47.879050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478446+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:27.478446+0000","last_peered":"2024-04-26T12:13:27.478446+0000","last_clean":"2024-04-26T12:13:27.478446+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:27.478446+0000","last_undegraded":"2024-04-26T12:13:27.478446+0000","last_fullsized":"2024-04-26T12:13:27.478446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.480926+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.480926+0000","last_peered":"2024-04-26T12:13:39.480926+0000","last_clean":"2024-04-26T12:13:39.480926+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.480926+0000","last_undegraded":"2024-04-26T12:13:39.480926+0000","last_fullsized":"2024-04-26T12:13:39.480926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476330+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:27.476330+0000","last_peered":"2024-04-26T12:13:27.476330+0000","last_clean":"2024-04-26T12:13:27.476330+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:27.476330+0000","last_undegraded":"2024-04-26T12:13:27.476330+0000","last_fullsized":"2024-04-26T12:13:27.476330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477726+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:27.477726+0000","last_peered":"2024-04-26T12:13:27.477726+0000","last_clean":"2024-04-26T12:13:27.477726+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:27.477726+0000","last_undegraded":"2024-04-26T12:13:27.477726+0000","last_fullsized":"2024-04-26T12:13:27.477726+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477520+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:27.477520+0000","last_peered":"2024-04-26T12:13:27.477520+0000","last_clean":"2024-04-26T12:13:27.477520+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:27.477520+0000","last_undegraded":"2024-04-26T12:13:27.477520+0000","last_fullsized":"2024-04-26T12:13:27.477520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.864959+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.864959+0000","last_peered":"2024-04-26T12:13:37.864959+0000","last_clean":"2024-04-26T12:13:37.864959+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.864959+0000","last_undegraded":"2024-04-26T12:13:37.864959+0000","last_fullsized":"2024-04-26T12:13:37.864959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831402+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:28.831402+0000","last_peered":"2024-04-26T12:13:28.831402+0000","last_clean":"2024-04-26T12:13:28.831402+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:28.831402+0000","last_undegraded":"2024-04-26T12:13:28.831402+0000","last_fullsized":"2024-04-26T12:13:28.831402+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478334+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:27.478334+0000","last_peered":"2024-04-26T12:13:27.478334+0000","last_clean":"2024-04-26T12:13:27.478334+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:27.478334+0000","last_undegraded":"2024-04-26T12:13:27.478334+0000","last_fullsized":"2024-04-26T12:13:27.478334+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831425+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:28.831425+0000","last_peered":"2024-04-26T12:13:28.831425+0000","last_clean":"2024-04-26T12:13:28.831425+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:28.831425+0000","last_undegraded":"2024-04-26T12:13:28.831425+0000","last_fullsized":"2024-04-26T12:13:28.831425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476885+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:27.476885+0000","last_peered":"2024-04-26T12:13:27.476885+0000","last_clean":"2024-04-26T12:13:27.476885+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:27.476885+0000","last_undegraded":"2024-04-26T12:13:27.476885+0000","last_fullsized":"2024-04-26T12:13:27.476885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476885+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:27.476885+0000","last_peered":"2024-04-26T12:13:27.476885+0000","last_clean":"2024-04-26T12:13:27.476885+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:27.476885+0000","last_undegraded":"2024-04-26T12:13:27.476885+0000","last_fullsized":"2024-04-26T12:13:27.476885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831220+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:28.831220+0000","last_peered":"2024-04-26T12:13:28.831220+0000","last_clean":"2024-04-26T12:13:28.831220+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:28.831220+0000","last_undegraded":"2024-04-26T12:13:28.831220+0000","last_fullsized":"2024-04-26T12:13:28.831220+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961962+0000","last_change":"2024-04-26T12:13:14.391971+0000","last_active":"2024-04-26T12:13:35.961962+0000","last_peered":"2024-04-26T12:13:35.961962+0000","last_clean":"2024-04-26T12:13:35.961962+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:13:35.961962+0000","last_undegraded":"2024-04-26T12:13:35.961962+0000","last_fullsized":"2024-04-26T12:13:35.961962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831974+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:28.831974+0000","last_peered":"2024-04-26T12:13:28.831974+0000","last_clean":"2024-04-26T12:13:28.831974+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:28.831974+0000","last_undegraded":"2024-04-26T12:13:28.831974+0000","last_fullsized":"2024-04-26T12:13:28.831974+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476712+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:27.476712+0000","last_peered":"2024-04-26T12:13:27.476712+0000","last_clean":"2024-04-26T12:13:27.476712+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:27.476712+0000","last_undegraded":"2024-04-26T12:13:27.476712+0000","last_fullsized":"2024-04-26T12:13:27.476712+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831520+0000","last_change":"2024-04-26T12:13:14.391264+0000","last_active":"2024-04-26T12:13:28.831520+0000","last_peered":"2024-04-26T12:13:28.831520+0000","last_clean":"2024-04-26T12:13:28.831520+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:13:28.831520+0000","last_undegraded":"2024-04-26T12:13:28.831520+0000","last_fullsized":"2024-04-26T12:13:28.831520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":85,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476430+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:27.476430+0000","last_peered":"2024-04-26T12:13:27.476430+0000","last_clean":"2024-04-26T12:13:27.476430+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:27.476430+0000","last_undegraded":"2024-04-26T12:13:27.476430+0000","last_fullsized":"2024-04-26T12:13:27.476430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":221,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477156+0000","last_change":"2024-04-26T12:13:14.389794+0000","last_active":"2024-04-26T12:13:27.477156+0000","last_peered":"2024-04-26T12:13:27.477156+0000","last_clean":"2024-04-26T12:13:27.477156+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:27.477156+0000","last_undegraded":"2024-04-26T12:13:27.477156+0000","last_fullsized":"2024-04-26T12:13:27.477156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:43.900793+0000","last_clean_scrub_stamp":"2024-04-26T12:09:43.900793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476021+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:27.476021+0000","last_peered":"2024-04-26T12:13:27.476021+0000","last_clean":"2024-04-26T12:13:27.476021+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:27.476021+0000","last_undegraded":"2024-04-26T12:13:27.476021+0000","last_fullsized":"2024-04-26T12:13:27.476021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933176+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933176+0000","last_peered":"2024-04-26T12:13:48.933176+0000","last_clean":"2024-04-26T12:13:48.933176+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933176+0000","last_undegraded":"2024-04-26T12:13:48.933176+0000","last_fullsized":"2024-04-26T12:13:48.933176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477660+0000","last_change":"2024-04-26T12:13:14.388481+0000","last_active":"2024-04-26T12:13:27.477660+0000","last_peered":"2024-04-26T12:13:27.477660+0000","last_clean":"2024-04-26T12:13:27.477660+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:27.477660+0000","last_undegraded":"2024-04-26T12:13:27.477660+0000","last_fullsized":"2024-04-26T12:13:27.477660+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403253+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:35.403253+0000","last_peered":"2024-04-26T12:13:35.403253+0000","last_clean":"2024-04-26T12:13:35.403253+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:35.403253+0000","last_undegraded":"2024-04-26T12:13:35.403253+0000","last_fullsized":"2024-04-26T12:13:35.403253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477025+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:27.477025+0000","last_peered":"2024-04-26T12:13:27.477025+0000","last_clean":"2024-04-26T12:13:27.477025+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:27.477025+0000","last_undegraded":"2024-04-26T12:13:27.477025+0000","last_fullsized":"2024-04-26T12:13:27.477025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833452+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833452+0000","last_peered":"2024-04-26T12:13:42.833452+0000","last_clean":"2024-04-26T12:13:42.833452+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833452+0000","last_undegraded":"2024-04-26T12:13:42.833452+0000","last_fullsized":"2024-04-26T12:13:42.833452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476167+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:27.476167+0000","last_peered":"2024-04-26T12:13:27.476167+0000","last_clean":"2024-04-26T12:13:27.476167+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:27.476167+0000","last_undegraded":"2024-04-26T12:13:27.476167+0000","last_fullsized":"2024-04-26T12:13:27.476167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478156+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:27.478156+0000","last_peered":"2024-04-26T12:13:27.478156+0000","last_clean":"2024-04-26T12:13:27.478156+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:27.478156+0000","last_undegraded":"2024-04-26T12:13:27.478156+0000","last_fullsized":"2024-04-26T12:13:27.478156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831140+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:28.831140+0000","last_peered":"2024-04-26T12:13:28.831140+0000","last_clean":"2024-04-26T12:13:28.831140+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:28.831140+0000","last_undegraded":"2024-04-26T12:13:28.831140+0000","last_fullsized":"2024-04-26T12:13:28.831140+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477543+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:27.477543+0000","last_peered":"2024-04-26T12:13:27.477543+0000","last_clean":"2024-04-26T12:13:27.477543+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:27.477543+0000","last_undegraded":"2024-04-26T12:13:27.477543+0000","last_fullsized":"2024-04-26T12:13:27.477543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476832+0000","last_change":"2024-04-26T12:09:49.380250+0000","last_active":"2024-04-26T12:13:27.476832+0000","last_peered":"2024-04-26T12:13:27.476832+0000","last_clean":"2024-04-26T12:13:27.476832+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:13:27.476832+0000","last_undegraded":"2024-04-26T12:13:27.476832+0000","last_fullsized":"2024-04-26T12:13:27.476832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832277+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:28.832277+0000","last_peered":"2024-04-26T12:13:28.832277+0000","last_clean":"2024-04-26T12:13:28.832277+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:28.832277+0000","last_undegraded":"2024-04-26T12:13:28.832277+0000","last_fullsized":"2024-04-26T12:13:28.832277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476933+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:27.476933+0000","last_peered":"2024-04-26T12:13:27.476933+0000","last_clean":"2024-04-26T12:13:27.476933+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:27.476933+0000","last_undegraded":"2024-04-26T12:13:27.476933+0000","last_fullsized":"2024-04-26T12:13:27.476933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831695+0000","last_change":"2024-04-26T12:13:14.394635+0000","last_active":"2024-04-26T12:13:28.831695+0000","last_peered":"2024-04-26T12:13:28.831695+0000","last_clean":"2024-04-26T12:13:28.831695+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:28.831695+0000","last_undegraded":"2024-04-26T12:13:28.831695+0000","last_fullsized":"2024-04-26T12:13:28.831695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478450+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:27.478450+0000","last_peered":"2024-04-26T12:13:27.478450+0000","last_clean":"2024-04-26T12:13:27.478450+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:27.478450+0000","last_undegraded":"2024-04-26T12:13:27.478450+0000","last_fullsized":"2024-04-26T12:13:27.478450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831763+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:28.831763+0000","last_peered":"2024-04-26T12:13:28.831763+0000","last_clean":"2024-04-26T12:13:28.831763+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:28.831763+0000","last_undegraded":"2024-04-26T12:13:28.831763+0000","last_fullsized":"2024-04-26T12:13:28.831763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831751+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:28.831751+0000","last_peered":"2024-04-26T12:13:28.831751+0000","last_clean":"2024-04-26T12:13:28.831751+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:28.831751+0000","last_undegraded":"2024-04-26T12:13:28.831751+0000","last_fullsized":"2024-04-26T12:13:28.831751+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832064+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:28.832064+0000","last_peered":"2024-04-26T12:13:28.832064+0000","last_clean":"2024-04-26T12:13:28.832064+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:28.832064+0000","last_undegraded":"2024-04-26T12:13:28.832064+0000","last_fullsized":"2024-04-26T12:13:28.832064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477877+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:27.477877+0000","last_peered":"2024-04-26T12:13:27.477877+0000","last_clean":"2024-04-26T12:13:27.477877+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:27.477877+0000","last_undegraded":"2024-04-26T12:13:27.477877+0000","last_fullsized":"2024-04-26T12:13:27.477877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477975+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:27.477975+0000","last_peered":"2024-04-26T12:13:27.477975+0000","last_clean":"2024-04-26T12:13:27.477975+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:27.477975+0000","last_undegraded":"2024-04-26T12:13:27.477975+0000","last_fullsized":"2024-04-26T12:13:27.477975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477989+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:27.477989+0000","last_peered":"2024-04-26T12:13:27.477989+0000","last_clean":"2024-04-26T12:13:27.477989+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:27.477989+0000","last_undegraded":"2024-04-26T12:13:27.477989+0000","last_fullsized":"2024-04-26T12:13:27.477989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477370+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:27.477370+0000","last_peered":"2024-04-26T12:13:27.477370+0000","last_clean":"2024-04-26T12:13:27.477370+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:27.477370+0000","last_undegraded":"2024-04-26T12:13:27.477370+0000","last_fullsized":"2024-04-26T12:13:27.477370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961914+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:35.961914+0000","last_peered":"2024-04-26T12:13:35.961914+0000","last_clean":"2024-04-26T12:13:35.961914+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:35.961914+0000","last_undegraded":"2024-04-26T12:13:35.961914+0000","last_fullsized":"2024-04-26T12:13:35.961914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831634+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:28.831634+0000","last_peered":"2024-04-26T12:13:28.831634+0000","last_clean":"2024-04-26T12:13:28.831634+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:28.831634+0000","last_undegraded":"2024-04-26T12:13:28.831634+0000","last_fullsized":"2024-04-26T12:13:28.831634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403469+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403469+0000","last_peered":"2024-04-26T12:13:51.403469+0000","last_clean":"2024-04-26T12:13:51.403469+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403469+0000","last_undegraded":"2024-04-26T12:13:51.403469+0000","last_fullsized":"2024-04-26T12:13:51.403469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477372+0000","last_change":"2024-04-26T12:13:14.392329+0000","last_active":"2024-04-26T12:13:27.477372+0000","last_peered":"2024-04-26T12:13:27.477372+0000","last_clean":"2024-04-26T12:13:27.477372+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:27.477372+0000","last_undegraded":"2024-04-26T12:13:27.477372+0000","last_fullsized":"2024-04-26T12:13:27.477372+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477375+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:27.477375+0000","last_peered":"2024-04-26T12:13:27.477375+0000","last_clean":"2024-04-26T12:13:27.477375+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:27.477375+0000","last_undegraded":"2024-04-26T12:13:27.477375+0000","last_fullsized":"2024-04-26T12:13:27.477375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406175+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406175+0000","last_peered":"2024-04-26T12:13:47.406175+0000","last_clean":"2024-04-26T12:13:47.406175+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406175+0000","last_undegraded":"2024-04-26T12:13:47.406175+0000","last_fullsized":"2024-04-26T12:13:47.406175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831787+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:28.831787+0000","last_peered":"2024-04-26T12:13:28.831787+0000","last_clean":"2024-04-26T12:13:28.831787+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:28.831787+0000","last_undegraded":"2024-04-26T12:13:28.831787+0000","last_fullsized":"2024-04-26T12:13:28.831787+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476589+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:27.476589+0000","last_peered":"2024-04-26T12:13:27.476589+0000","last_clean":"2024-04-26T12:13:27.476589+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:27.476589+0000","last_undegraded":"2024-04-26T12:13:27.476589+0000","last_fullsized":"2024-04-26T12:13:27.476589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928228+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928228+0000","last_peered":"2024-04-26T12:13:51.928228+0000","last_clean":"2024-04-26T12:13:51.928228+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928228+0000","last_undegraded":"2024-04-26T12:13:51.928228+0000","last_fullsized":"2024-04-26T12:13:51.928228+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:12:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.44},"min":{"1min":0.19800000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.99399999999999999,"5min":1.504,"15min":1.504},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.20300000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.52700000000000002,"5min":2.383,"15min":2.383},"last":0.52700000000000002}]}]},{"osd":0,"up_from":64,"seq":274877906954,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738421,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.504},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.35299999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.69099999999999995,"5min":2.214,"15min":2.214},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.505,"15min":0.432},"min":{"1min":0.35899999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.66800000000000004,"5min":2.294,"15min":2.294},"last":0.48299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:13:56.778 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.779 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.780 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.781 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.781 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.781 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.781 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.782 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.783 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.784 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.785 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.786 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:09:43.900793+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.786 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.786 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.786 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.786 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.786 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.787 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.788 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.789 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.789 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.789 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.789 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:13:56.789 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:14:16.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:17.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:14:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:14:17.201 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-26T12:14:16.934470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895460+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895460+0000","last_peered":"2024-04-26T12:13:40.895460+0000","last_clean":"2024-04-26T12:13:40.895460+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895460+0000","last_undegraded":"2024-04-26T12:13:40.895460+0000","last_fullsized":"2024-04-26T12:13:40.895460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403735+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:35.403735+0000","last_peered":"2024-04-26T12:13:35.403735+0000","last_clean":"2024-04-26T12:13:35.403735+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:35.403735+0000","last_undegraded":"2024-04-26T12:13:35.403735+0000","last_fullsized":"2024-04-26T12:13:35.403735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900330+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900330+0000","last_peered":"2024-04-26T12:13:39.900330+0000","last_clean":"2024-04-26T12:13:39.900330+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900330+0000","last_undegraded":"2024-04-26T12:13:39.900330+0000","last_fullsized":"2024-04-26T12:13:39.900330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478159+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:27.478159+0000","last_peered":"2024-04-26T12:13:27.478159+0000","last_clean":"2024-04-26T12:13:27.478159+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:27.478159+0000","last_undegraded":"2024-04-26T12:13:27.478159+0000","last_fullsized":"2024-04-26T12:13:27.478159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831507+0000","last_change":"2024-04-26T12:09:49.371673+0000","last_active":"2024-04-26T12:13:28.831507+0000","last_peered":"2024-04-26T12:13:28.831507+0000","last_clean":"2024-04-26T12:13:28.831507+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:13:28.831507+0000","last_undegraded":"2024-04-26T12:13:28.831507+0000","last_fullsized":"2024-04-26T12:13:28.831507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477196+0000","last_change":"2024-04-26T12:13:14.386620+0000","last_active":"2024-04-26T12:13:27.477196+0000","last_peered":"2024-04-26T12:13:27.477196+0000","last_clean":"2024-04-26T12:13:27.477196+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:13:27.477196+0000","last_undegraded":"2024-04-26T12:13:27.477196+0000","last_fullsized":"2024-04-26T12:13:27.477196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477296+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:27.477296+0000","last_peered":"2024-04-26T12:13:27.477296+0000","last_clean":"2024-04-26T12:13:27.477296+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:27.477296+0000","last_undegraded":"2024-04-26T12:13:27.477296+0000","last_fullsized":"2024-04-26T12:13:27.477296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476972+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:27.476972+0000","last_peered":"2024-04-26T12:13:27.476972+0000","last_clean":"2024-04-26T12:13:27.476972+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:27.476972+0000","last_undegraded":"2024-04-26T12:13:27.476972+0000","last_fullsized":"2024-04-26T12:13:27.476972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476738+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:27.476738+0000","last_peered":"2024-04-26T12:13:27.476738+0000","last_clean":"2024-04-26T12:13:27.476738+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:27.476738+0000","last_undegraded":"2024-04-26T12:13:27.476738+0000","last_fullsized":"2024-04-26T12:13:27.476738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832350+0000","last_change":"2024-04-26T12:09:49.373093+0000","last_active":"2024-04-26T12:13:28.832350+0000","last_peered":"2024-04-26T12:13:28.832350+0000","last_clean":"2024-04-26T12:13:28.832350+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:13:28.832350+0000","last_undegraded":"2024-04-26T12:13:28.832350+0000","last_fullsized":"2024-04-26T12:13:28.832350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478599+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:27.478599+0000","last_peered":"2024-04-26T12:13:27.478599+0000","last_clean":"2024-04-26T12:13:27.478599+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:27.478599+0000","last_undegraded":"2024-04-26T12:13:27.478599+0000","last_fullsized":"2024-04-26T12:13:27.478599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831871+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:28.831871+0000","last_peered":"2024-04-26T12:13:28.831871+0000","last_clean":"2024-04-26T12:13:28.831871+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:28.831871+0000","last_undegraded":"2024-04-26T12:13:28.831871+0000","last_fullsized":"2024-04-26T12:13:28.831871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768118+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768118+0000","last_peered":"2024-04-26T12:13:37.768118+0000","last_clean":"2024-04-26T12:13:37.768118+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768118+0000","last_undegraded":"2024-04-26T12:13:37.768118+0000","last_fullsized":"2024-04-26T12:13:37.768118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477835+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:27.477835+0000","last_peered":"2024-04-26T12:13:27.477835+0000","last_clean":"2024-04-26T12:13:27.477835+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:27.477835+0000","last_undegraded":"2024-04-26T12:13:27.477835+0000","last_fullsized":"2024-04-26T12:13:27.477835+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477719+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:27.477719+0000","last_peered":"2024-04-26T12:13:27.477719+0000","last_clean":"2024-04-26T12:13:27.477719+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:27.477719+0000","last_undegraded":"2024-04-26T12:13:27.477719+0000","last_fullsized":"2024-04-26T12:13:27.477719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477665+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:27.477665+0000","last_peered":"2024-04-26T12:13:27.477665+0000","last_clean":"2024-04-26T12:13:27.477665+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:27.477665+0000","last_undegraded":"2024-04-26T12:13:27.477665+0000","last_fullsized":"2024-04-26T12:13:27.477665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476773+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:27.476773+0000","last_peered":"2024-04-26T12:13:27.476773+0000","last_clean":"2024-04-26T12:13:27.476773+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:27.476773+0000","last_undegraded":"2024-04-26T12:13:27.476773+0000","last_fullsized":"2024-04-26T12:13:27.476773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832319+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:28.832319+0000","last_peered":"2024-04-26T12:13:28.832319+0000","last_clean":"2024-04-26T12:13:28.832319+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:28.832319+0000","last_undegraded":"2024-04-26T12:13:28.832319+0000","last_fullsized":"2024-04-26T12:13:28.832319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476586+0000","last_change":"2024-04-26T12:09:49.379266+0000","last_active":"2024-04-26T12:13:27.476586+0000","last_peered":"2024-04-26T12:13:27.476586+0000","last_clean":"2024-04-26T12:13:27.476586+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:13:27.476586+0000","last_undegraded":"2024-04-26T12:13:27.476586+0000","last_fullsized":"2024-04-26T12:13:27.476586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.938926+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.938926+0000","last_peered":"2024-04-26T12:14:06.938926+0000","last_clean":"2024-04-26T12:14:06.938926+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.938926+0000","last_undegraded":"2024-04-26T12:14:06.938926+0000","last_fullsized":"2024-04-26T12:14:06.938926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477350+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:27.477350+0000","last_peered":"2024-04-26T12:13:27.477350+0000","last_clean":"2024-04-26T12:13:27.477350+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:27.477350+0000","last_undegraded":"2024-04-26T12:13:27.477350+0000","last_fullsized":"2024-04-26T12:13:27.477350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945662+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945662+0000","last_peered":"2024-04-26T12:13:55.945662+0000","last_clean":"2024-04-26T12:13:55.945662+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945662+0000","last_undegraded":"2024-04-26T12:13:55.945662+0000","last_fullsized":"2024-04-26T12:13:55.945662+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476439+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:27.476439+0000","last_peered":"2024-04-26T12:13:27.476439+0000","last_clean":"2024-04-26T12:13:27.476439+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:27.476439+0000","last_undegraded":"2024-04-26T12:13:27.476439+0000","last_fullsized":"2024-04-26T12:13:27.476439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962164+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:35.962164+0000","last_peered":"2024-04-26T12:13:35.962164+0000","last_clean":"2024-04-26T12:13:35.962164+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:35.962164+0000","last_undegraded":"2024-04-26T12:13:35.962164+0000","last_fullsized":"2024-04-26T12:13:35.962164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478701+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:27.478701+0000","last_peered":"2024-04-26T12:13:27.478701+0000","last_clean":"2024-04-26T12:13:27.478701+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:27.478701+0000","last_undegraded":"2024-04-26T12:13:27.478701+0000","last_fullsized":"2024-04-26T12:13:27.478701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831629+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:28.831629+0000","last_peered":"2024-04-26T12:13:28.831629+0000","last_clean":"2024-04-26T12:13:28.831629+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:28.831629+0000","last_undegraded":"2024-04-26T12:13:28.831629+0000","last_fullsized":"2024-04-26T12:13:28.831629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963106+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963106+0000","last_peered":"2024-04-26T12:13:54.963106+0000","last_clean":"2024-04-26T12:13:54.963106+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963106+0000","last_undegraded":"2024-04-26T12:13:54.963106+0000","last_fullsized":"2024-04-26T12:13:54.963106+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384494+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384494+0000","last_peered":"2024-04-26T12:13:56.384494+0000","last_clean":"2024-04-26T12:13:56.384494+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384494+0000","last_undegraded":"2024-04-26T12:13:56.384494+0000","last_fullsized":"2024-04-26T12:13:56.384494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962136+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:35.962136+0000","last_peered":"2024-04-26T12:13:35.962136+0000","last_clean":"2024-04-26T12:13:35.962136+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:35.962136+0000","last_undegraded":"2024-04-26T12:13:35.962136+0000","last_fullsized":"2024-04-26T12:13:35.962136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345186+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345186+0000","last_peered":"2024-04-26T12:14:06.345186+0000","last_clean":"2024-04-26T12:14:06.345186+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345186+0000","last_undegraded":"2024-04-26T12:14:06.345186+0000","last_fullsized":"2024-04-26T12:14:06.345186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.973075+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.973075+0000","last_peered":"2024-04-26T12:13:46.973075+0000","last_clean":"2024-04-26T12:13:46.973075+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.973075+0000","last_undegraded":"2024-04-26T12:13:46.973075+0000","last_fullsized":"2024-04-26T12:13:46.973075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476986+0000","last_change":"2024-04-26T12:13:14.391310+0000","last_active":"2024-04-26T12:13:27.476986+0000","last_peered":"2024-04-26T12:13:27.476986+0000","last_clean":"2024-04-26T12:13:27.476986+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:13:27.476986+0000","last_undegraded":"2024-04-26T12:13:27.476986+0000","last_fullsized":"2024-04-26T12:13:27.476986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448430+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448430+0000","last_peered":"2024-04-26T12:13:40.448430+0000","last_clean":"2024-04-26T12:13:40.448430+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448430+0000","last_undegraded":"2024-04-26T12:13:40.448430+0000","last_fullsized":"2024-04-26T12:13:40.448430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.968945+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.968945+0000","last_peered":"2024-04-26T12:14:08.968945+0000","last_clean":"2024-04-26T12:14:08.968945+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.968945+0000","last_undegraded":"2024-04-26T12:14:08.968945+0000","last_fullsized":"2024-04-26T12:14:08.968945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.428892+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.428892+0000","last_peered":"2024-04-26T12:13:55.428892+0000","last_clean":"2024-04-26T12:13:55.428892+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.428892+0000","last_undegraded":"2024-04-26T12:13:55.428892+0000","last_fullsized":"2024-04-26T12:13:55.428892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832122+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:28.832122+0000","last_peered":"2024-04-26T12:13:28.832122+0000","last_clean":"2024-04-26T12:13:28.832122+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:28.832122+0000","last_undegraded":"2024-04-26T12:13:28.832122+0000","last_fullsized":"2024-04-26T12:13:28.832122+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448224+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448224+0000","last_peered":"2024-04-26T12:13:38.448224+0000","last_clean":"2024-04-26T12:13:38.448224+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448224+0000","last_undegraded":"2024-04-26T12:13:38.448224+0000","last_fullsized":"2024-04-26T12:13:38.448224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478313+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:27.478313+0000","last_peered":"2024-04-26T12:13:27.478313+0000","last_clean":"2024-04-26T12:13:27.478313+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:27.478313+0000","last_undegraded":"2024-04-26T12:13:27.478313+0000","last_fullsized":"2024-04-26T12:13:27.478313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477609+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:27.477609+0000","last_peered":"2024-04-26T12:13:27.477609+0000","last_clean":"2024-04-26T12:13:27.477609+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:27.477609+0000","last_undegraded":"2024-04-26T12:13:27.477609+0000","last_fullsized":"2024-04-26T12:13:27.477609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863557+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863557+0000","last_peered":"2024-04-26T12:13:43.863557+0000","last_clean":"2024-04-26T12:13:43.863557+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863557+0000","last_undegraded":"2024-04-26T12:13:43.863557+0000","last_fullsized":"2024-04-26T12:13:43.863557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476173+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:27.476173+0000","last_peered":"2024-04-26T12:13:27.476173+0000","last_clean":"2024-04-26T12:13:27.476173+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:27.476173+0000","last_undegraded":"2024-04-26T12:13:27.476173+0000","last_fullsized":"2024-04-26T12:13:27.476173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916371+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916371+0000","last_peered":"2024-04-26T12:13:45.916371+0000","last_clean":"2024-04-26T12:13:45.916371+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916371+0000","last_undegraded":"2024-04-26T12:13:45.916371+0000","last_fullsized":"2024-04-26T12:13:45.916371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994006+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994006+0000","last_peered":"2024-04-26T12:14:11.994006+0000","last_clean":"2024-04-26T12:14:11.994006+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994006+0000","last_undegraded":"2024-04-26T12:14:11.994006+0000","last_fullsized":"2024-04-26T12:14:11.994006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433233+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433233+0000","last_peered":"2024-04-26T12:13:46.433233+0000","last_clean":"2024-04-26T12:13:46.433233+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433233+0000","last_undegraded":"2024-04-26T12:13:46.433233+0000","last_fullsized":"2024-04-26T12:13:46.433233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":31,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477218+0000","last_change":"2024-04-26T12:13:14.390028+0000","last_active":"2024-04-26T12:13:27.477218+0000","last_peered":"2024-04-26T12:13:27.477218+0000","last_clean":"2024-04-26T12:13:27.477218+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:13:27.477218+0000","last_undegraded":"2024-04-26T12:13:27.477218+0000","last_fullsized":"2024-04-26T12:13:27.477218+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433025+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433025+0000","last_peered":"2024-04-26T12:13:48.433025+0000","last_clean":"2024-04-26T12:13:48.433025+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433025+0000","last_undegraded":"2024-04-26T12:13:48.433025+0000","last_fullsized":"2024-04-26T12:13:48.433025+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478494+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:27.478494+0000","last_peered":"2024-04-26T12:13:27.478494+0000","last_clean":"2024-04-26T12:13:27.478494+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:27.478494+0000","last_undegraded":"2024-04-26T12:13:27.478494+0000","last_fullsized":"2024-04-26T12:13:27.478494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403442+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:35.403442+0000","last_peered":"2024-04-26T12:13:35.403442+0000","last_clean":"2024-04-26T12:13:35.403442+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:35.403442+0000","last_undegraded":"2024-04-26T12:13:35.403442+0000","last_fullsized":"2024-04-26T12:13:35.403442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832187+0000","last_change":"2024-04-26T12:13:14.393107+0000","last_active":"2024-04-26T12:13:28.832187+0000","last_peered":"2024-04-26T12:13:28.832187+0000","last_clean":"2024-04-26T12:13:28.832187+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:13:28.832187+0000","last_undegraded":"2024-04-26T12:13:28.832187+0000","last_fullsized":"2024-04-26T12:13:28.832187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403551+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:35.403551+0000","last_peered":"2024-04-26T12:13:35.403551+0000","last_clean":"2024-04-26T12:13:35.403551+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:35.403551+0000","last_undegraded":"2024-04-26T12:13:35.403551+0000","last_fullsized":"2024-04-26T12:13:35.403551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478215+0000","last_change":"2024-04-26T12:13:14.390042+0000","last_active":"2024-04-26T12:13:27.478215+0000","last_peered":"2024-04-26T12:13:27.478215+0000","last_clean":"2024-04-26T12:13:27.478215+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:13:27.478215+0000","last_undegraded":"2024-04-26T12:13:27.478215+0000","last_fullsized":"2024-04-26T12:13:27.478215+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879050+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879050+0000","last_peered":"2024-04-26T12:13:47.879050+0000","last_clean":"2024-04-26T12:13:47.879050+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879050+0000","last_undegraded":"2024-04-26T12:13:47.879050+0000","last_fullsized":"2024-04-26T12:13:47.879050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478446+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:27.478446+0000","last_peered":"2024-04-26T12:13:27.478446+0000","last_clean":"2024-04-26T12:13:27.478446+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:27.478446+0000","last_undegraded":"2024-04-26T12:13:27.478446+0000","last_fullsized":"2024-04-26T12:13:27.478446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.480926+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.480926+0000","last_peered":"2024-04-26T12:13:39.480926+0000","last_clean":"2024-04-26T12:13:39.480926+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.480926+0000","last_undegraded":"2024-04-26T12:13:39.480926+0000","last_fullsized":"2024-04-26T12:13:39.480926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476330+0000","last_change":"2024-04-26T12:13:14.397120+0000","last_active":"2024-04-26T12:13:27.476330+0000","last_peered":"2024-04-26T12:13:27.476330+0000","last_clean":"2024-04-26T12:13:27.476330+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:13:27.476330+0000","last_undegraded":"2024-04-26T12:13:27.476330+0000","last_fullsized":"2024-04-26T12:13:27.476330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477726+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:27.477726+0000","last_peered":"2024-04-26T12:13:27.477726+0000","last_clean":"2024-04-26T12:13:27.477726+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:27.477726+0000","last_undegraded":"2024-04-26T12:13:27.477726+0000","last_fullsized":"2024-04-26T12:13:27.477726+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477520+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:27.477520+0000","last_peered":"2024-04-26T12:13:27.477520+0000","last_clean":"2024-04-26T12:13:27.477520+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:27.477520+0000","last_undegraded":"2024-04-26T12:13:27.477520+0000","last_fullsized":"2024-04-26T12:13:27.477520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.864959+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.864959+0000","last_peered":"2024-04-26T12:13:37.864959+0000","last_clean":"2024-04-26T12:13:37.864959+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.864959+0000","last_undegraded":"2024-04-26T12:13:37.864959+0000","last_fullsized":"2024-04-26T12:13:37.864959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403323+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:35.403323+0000","last_peered":"2024-04-26T12:13:35.403323+0000","last_clean":"2024-04-26T12:13:35.403323+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:35.403323+0000","last_undegraded":"2024-04-26T12:13:35.403323+0000","last_fullsized":"2024-04-26T12:13:35.403323+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478334+0000","last_change":"2024-04-26T12:13:14.390812+0000","last_active":"2024-04-26T12:13:27.478334+0000","last_peered":"2024-04-26T12:13:27.478334+0000","last_clean":"2024-04-26T12:13:27.478334+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:13:27.478334+0000","last_undegraded":"2024-04-26T12:13:27.478334+0000","last_fullsized":"2024-04-26T12:13:27.478334+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403257+0000","last_change":"2024-04-26T12:09:48.931512+0000","last_active":"2024-04-26T12:13:35.403257+0000","last_peered":"2024-04-26T12:13:35.403257+0000","last_clean":"2024-04-26T12:13:35.403257+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:13:35.403257+0000","last_undegraded":"2024-04-26T12:13:35.403257+0000","last_fullsized":"2024-04-26T12:13:35.403257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476885+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:27.476885+0000","last_peered":"2024-04-26T12:13:27.476885+0000","last_clean":"2024-04-26T12:13:27.476885+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:27.476885+0000","last_undegraded":"2024-04-26T12:13:27.476885+0000","last_fullsized":"2024-04-26T12:13:27.476885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":71,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961834+0000","last_change":"2024-04-26T12:09:48.932202+0000","last_active":"2024-04-26T12:13:35.961834+0000","last_peered":"2024-04-26T12:13:35.961834+0000","last_clean":"2024-04-26T12:13:35.961834+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:13:35.961834+0000","last_undegraded":"2024-04-26T12:13:35.961834+0000","last_fullsized":"2024-04-26T12:13:35.961834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":73,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403231+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:35.403231+0000","last_peered":"2024-04-26T12:13:35.403231+0000","last_clean":"2024-04-26T12:13:35.403231+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:35.403231+0000","last_undegraded":"2024-04-26T12:13:35.403231+0000","last_fullsized":"2024-04-26T12:13:35.403231+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344739+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344739+0000","last_peered":"2024-04-26T12:14:08.344739+0000","last_clean":"2024-04-26T12:14:08.344739+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344739+0000","last_undegraded":"2024-04-26T12:14:08.344739+0000","last_fullsized":"2024-04-26T12:14:08.344739+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403268+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:35.403268+0000","last_peered":"2024-04-26T12:13:35.403268+0000","last_clean":"2024-04-26T12:13:35.403268+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:35.403268+0000","last_undegraded":"2024-04-26T12:13:35.403268+0000","last_fullsized":"2024-04-26T12:13:35.403268+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961833+0000","last_change":"2024-04-26T12:13:14.392572+0000","last_active":"2024-04-26T12:13:35.961833+0000","last_peered":"2024-04-26T12:13:35.961833+0000","last_clean":"2024-04-26T12:13:35.961833+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:13:35.961833+0000","last_undegraded":"2024-04-26T12:13:35.961833+0000","last_fullsized":"2024-04-26T12:13:35.961833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985324+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985324+0000","last_peered":"2024-04-26T12:14:02.985324+0000","last_clean":"2024-04-26T12:14:02.985324+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985324+0000","last_undegraded":"2024-04-26T12:14:02.985324+0000","last_fullsized":"2024-04-26T12:14:02.985324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961783+0000","last_change":"2024-04-26T12:13:14.397158+0000","last_active":"2024-04-26T12:13:35.961783+0000","last_peered":"2024-04-26T12:13:35.961783+0000","last_clean":"2024-04-26T12:13:35.961783+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:13:35.961783+0000","last_undegraded":"2024-04-26T12:13:35.961783+0000","last_fullsized":"2024-04-26T12:13:35.961783+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":234,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764036+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764036+0000","last_peered":"2024-04-26T12:13:57.764036+0000","last_clean":"2024-04-26T12:13:57.764036+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764036+0000","last_undegraded":"2024-04-26T12:13:57.764036+0000","last_fullsized":"2024-04-26T12:13:57.764036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961775+0000","last_change":"2024-04-26T12:13:14.388907+0000","last_active":"2024-04-26T12:13:35.961775+0000","last_peered":"2024-04-26T12:13:35.961775+0000","last_clean":"2024-04-26T12:13:35.961775+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:13:35.961775+0000","last_undegraded":"2024-04-26T12:13:35.961775+0000","last_fullsized":"2024-04-26T12:13:35.961775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803306+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803306+0000","last_peered":"2024-04-26T12:13:53.803306+0000","last_clean":"2024-04-26T12:13:53.803306+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803306+0000","last_undegraded":"2024-04-26T12:13:53.803306+0000","last_fullsized":"2024-04-26T12:13:53.803306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403253+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:35.403253+0000","last_peered":"2024-04-26T12:13:35.403253+0000","last_clean":"2024-04-26T12:13:35.403253+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:35.403253+0000","last_undegraded":"2024-04-26T12:13:35.403253+0000","last_fullsized":"2024-04-26T12:13:35.403253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961954+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:35.961954+0000","last_peered":"2024-04-26T12:13:35.961954+0000","last_clean":"2024-04-26T12:13:35.961954+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:35.961954+0000","last_undegraded":"2024-04-26T12:13:35.961954+0000","last_fullsized":"2024-04-26T12:13:35.961954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833452+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833452+0000","last_peered":"2024-04-26T12:13:42.833452+0000","last_clean":"2024-04-26T12:13:42.833452+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833452+0000","last_undegraded":"2024-04-26T12:13:42.833452+0000","last_fullsized":"2024-04-26T12:13:42.833452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961772+0000","last_change":"2024-04-26T12:09:48.932040+0000","last_active":"2024-04-26T12:13:35.961772+0000","last_peered":"2024-04-26T12:13:35.961772+0000","last_clean":"2024-04-26T12:13:35.961772+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:13:35.961772+0000","last_undegraded":"2024-04-26T12:13:35.961772+0000","last_fullsized":"2024-04-26T12:13:35.961772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478156+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:27.478156+0000","last_peered":"2024-04-26T12:13:27.478156+0000","last_clean":"2024-04-26T12:13:27.478156+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:27.478156+0000","last_undegraded":"2024-04-26T12:13:27.478156+0000","last_fullsized":"2024-04-26T12:13:27.478156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403240+0000","last_change":"2024-04-26T12:09:43.906503+0000","last_active":"2024-04-26T12:13:35.403240+0000","last_peered":"2024-04-26T12:13:35.403240+0000","last_clean":"2024-04-26T12:13:35.403240+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:13:35.403240+0000","last_undegraded":"2024-04-26T12:13:35.403240+0000","last_fullsized":"2024-04-26T12:13:35.403240+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477543+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:27.477543+0000","last_peered":"2024-04-26T12:13:27.477543+0000","last_clean":"2024-04-26T12:13:27.477543+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:27.477543+0000","last_undegraded":"2024-04-26T12:13:27.477543+0000","last_fullsized":"2024-04-26T12:13:27.477543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300236+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300236+0000","last_peered":"2024-04-26T12:14:05.300236+0000","last_clean":"2024-04-26T12:14:05.300236+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300236+0000","last_undegraded":"2024-04-26T12:14:05.300236+0000","last_fullsized":"2024-04-26T12:14:05.300236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403248+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:35.403248+0000","last_peered":"2024-04-26T12:13:35.403248+0000","last_clean":"2024-04-26T12:13:35.403248+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:35.403248+0000","last_undegraded":"2024-04-26T12:13:35.403248+0000","last_fullsized":"2024-04-26T12:13:35.403248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961833+0000","last_change":"2024-04-26T12:09:48.931276+0000","last_active":"2024-04-26T12:13:35.961833+0000","last_peered":"2024-04-26T12:13:35.961833+0000","last_clean":"2024-04-26T12:13:35.961833+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:13:35.961833+0000","last_undegraded":"2024-04-26T12:13:35.961833+0000","last_fullsized":"2024-04-26T12:13:35.961833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.995143+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:13:53.995143+0000","last_peered":"2024-04-26T12:13:53.995143+0000","last_clean":"2024-04-26T12:13:53.995143+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:53.995143+0000","last_undegraded":"2024-04-26T12:13:53.995143+0000","last_fullsized":"2024-04-26T12:13:53.995143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478450+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:27.478450+0000","last_peered":"2024-04-26T12:13:27.478450+0000","last_clean":"2024-04-26T12:13:27.478450+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:27.478450+0000","last_undegraded":"2024-04-26T12:13:27.478450+0000","last_fullsized":"2024-04-26T12:13:27.478450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403488+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:35.403488+0000","last_peered":"2024-04-26T12:13:35.403488+0000","last_clean":"2024-04-26T12:13:35.403488+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:35.403488+0000","last_undegraded":"2024-04-26T12:13:35.403488+0000","last_fullsized":"2024-04-26T12:13:35.403488+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831751+0000","last_change":"2024-04-26T12:13:14.397610+0000","last_active":"2024-04-26T12:13:28.831751+0000","last_peered":"2024-04-26T12:13:28.831751+0000","last_clean":"2024-04-26T12:13:28.831751+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:13:28.831751+0000","last_undegraded":"2024-04-26T12:13:28.831751+0000","last_fullsized":"2024-04-26T12:13:28.831751+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832064+0000","last_change":"2024-04-26T12:09:49.371799+0000","last_active":"2024-04-26T12:13:28.832064+0000","last_peered":"2024-04-26T12:13:28.832064+0000","last_clean":"2024-04-26T12:13:28.832064+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:13:28.832064+0000","last_undegraded":"2024-04-26T12:13:28.832064+0000","last_fullsized":"2024-04-26T12:13:28.832064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477877+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:27.477877+0000","last_peered":"2024-04-26T12:13:27.477877+0000","last_clean":"2024-04-26T12:13:27.477877+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:27.477877+0000","last_undegraded":"2024-04-26T12:13:27.477877+0000","last_fullsized":"2024-04-26T12:13:27.477877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477975+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:27.477975+0000","last_peered":"2024-04-26T12:13:27.477975+0000","last_clean":"2024-04-26T12:13:27.477975+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:27.477975+0000","last_undegraded":"2024-04-26T12:13:27.477975+0000","last_fullsized":"2024-04-26T12:13:27.477975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477989+0000","last_change":"2024-04-26T12:13:14.387386+0000","last_active":"2024-04-26T12:13:27.477989+0000","last_peered":"2024-04-26T12:13:27.477989+0000","last_clean":"2024-04-26T12:13:27.477989+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:13:27.477989+0000","last_undegraded":"2024-04-26T12:13:27.477989+0000","last_fullsized":"2024-04-26T12:13:27.477989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477370+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:27.477370+0000","last_peered":"2024-04-26T12:13:27.477370+0000","last_clean":"2024-04-26T12:13:27.477370+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:27.477370+0000","last_undegraded":"2024-04-26T12:13:27.477370+0000","last_fullsized":"2024-04-26T12:13:27.477370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961914+0000","last_change":"2024-04-26T12:09:48.932090+0000","last_active":"2024-04-26T12:13:35.961914+0000","last_peered":"2024-04-26T12:13:35.961914+0000","last_clean":"2024-04-26T12:13:35.961914+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:13:35.961914+0000","last_undegraded":"2024-04-26T12:13:35.961914+0000","last_fullsized":"2024-04-26T12:13:35.961914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831634+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:28.831634+0000","last_peered":"2024-04-26T12:13:28.831634+0000","last_clean":"2024-04-26T12:13:28.831634+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:28.831634+0000","last_undegraded":"2024-04-26T12:13:28.831634+0000","last_fullsized":"2024-04-26T12:13:28.831634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":99,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403595+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403595+0000","last_peered":"2024-04-26T12:13:51.403595+0000","last_clean":"2024-04-26T12:13:51.403595+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403595+0000","last_undegraded":"2024-04-26T12:13:51.403595+0000","last_fullsized":"2024-04-26T12:13:51.403595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798515+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798515+0000","last_peered":"2024-04-26T12:13:55.798515+0000","last_clean":"2024-04-26T12:13:55.798515+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798515+0000","last_undegraded":"2024-04-26T12:13:55.798515+0000","last_fullsized":"2024-04-26T12:13:55.798515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477375+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:27.477375+0000","last_peered":"2024-04-26T12:13:27.477375+0000","last_clean":"2024-04-26T12:13:27.477375+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:27.477375+0000","last_undegraded":"2024-04-26T12:13:27.477375+0000","last_fullsized":"2024-04-26T12:13:27.477375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406311+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406311+0000","last_peered":"2024-04-26T12:13:47.406311+0000","last_clean":"2024-04-26T12:13:47.406311+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406311+0000","last_undegraded":"2024-04-26T12:13:47.406311+0000","last_fullsized":"2024-04-26T12:13:47.406311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403544+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:35.403544+0000","last_peered":"2024-04-26T12:13:35.403544+0000","last_clean":"2024-04-26T12:13:35.403544+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:35.403544+0000","last_undegraded":"2024-04-26T12:13:35.403544+0000","last_fullsized":"2024-04-26T12:13:35.403544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962163+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:35.962163+0000","last_peered":"2024-04-26T12:13:35.962163+0000","last_clean":"2024-04-26T12:13:35.962163+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:35.962163+0000","last_undegraded":"2024-04-26T12:13:35.962163+0000","last_fullsized":"2024-04-26T12:13:35.962163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Apr 26 12:13:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.36199999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.56699999999999995,"5min":1.504,"15min":1.504},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52100000000000002,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.55900000000000005,"5min":2.383,"15min":2.383},"last":0.57899999999999996}]}]},{"osd":0,"up_from":64,"seq":274877906958,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:10:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.35299999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.69099999999999995,"5min":2.214,"15min":2.214},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.503,"5min":0.505,"15min":0.432},"min":{"1min":0.35899999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.66800000000000004,"5min":2.294,"15min":2.294},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.206 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.207 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.208 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.209 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.210 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.211 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.212 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.213 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.214 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:17.214 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:14:37.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:37.597 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:14:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:14:37.610 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-04-26T12:14:36.939279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002680"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895460+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895460+0000","last_peered":"2024-04-26T12:13:40.895460+0000","last_clean":"2024-04-26T12:13:40.895460+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895460+0000","last_undegraded":"2024-04-26T12:13:40.895460+0000","last_fullsized":"2024-04-26T12:13:40.895460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403735+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:35.403735+0000","last_peered":"2024-04-26T12:13:35.403735+0000","last_clean":"2024-04-26T12:13:35.403735+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:35.403735+0000","last_undegraded":"2024-04-26T12:13:35.403735+0000","last_fullsized":"2024-04-26T12:13:35.403735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900330+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900330+0000","last_peered":"2024-04-26T12:13:39.900330+0000","last_clean":"2024-04-26T12:13:39.900330+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900330+0000","last_undegraded":"2024-04-26T12:13:39.900330+0000","last_fullsized":"2024-04-26T12:13:39.900330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478159+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:27.478159+0000","last_peered":"2024-04-26T12:13:27.478159+0000","last_clean":"2024-04-26T12:13:27.478159+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:27.478159+0000","last_undegraded":"2024-04-26T12:13:27.478159+0000","last_fullsized":"2024-04-26T12:13:27.478159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.957015+0000","last_change":"2024-04-26T12:14:21.957122+0000","last_active":"2024-04-26T12:14:21.957015+0000","last_peered":"2024-04-26T12:14:21.957015+0000","last_clean":"2024-04-26T12:14:21.957015+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:14:21.957015+0000","last_undegraded":"2024-04-26T12:14:21.957015+0000","last_fullsized":"2024-04-26T12:14:21.957015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.956989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.739324+0000","scrub_duration":0.017760125000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.857322+0000","last_change":"2024-04-26T12:14:30.857441+0000","last_active":"2024-04-26T12:14:30.857322+0000","last_peered":"2024-04-26T12:14:30.857322+0000","last_clean":"2024-04-26T12:14:30.857322+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:14:30.857322+0000","last_undegraded":"2024-04-26T12:14:30.857322+0000","last_fullsized":"2024-04-26T12:14:30.857322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.857300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:25.197434+0000","scrub_duration":0.0017286269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477296+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:27.477296+0000","last_peered":"2024-04-26T12:13:27.477296+0000","last_clean":"2024-04-26T12:13:27.477296+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:27.477296+0000","last_undegraded":"2024-04-26T12:13:27.477296+0000","last_fullsized":"2024-04-26T12:13:27.477296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476972+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:27.476972+0000","last_peered":"2024-04-26T12:13:27.476972+0000","last_clean":"2024-04-26T12:13:27.476972+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:27.476972+0000","last_undegraded":"2024-04-26T12:13:27.476972+0000","last_fullsized":"2024-04-26T12:13:27.476972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476738+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:27.476738+0000","last_peered":"2024-04-26T12:13:27.476738+0000","last_clean":"2024-04-26T12:13:27.476738+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:27.476738+0000","last_undegraded":"2024-04-26T12:13:27.476738+0000","last_fullsized":"2024-04-26T12:13:27.476738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:27.017112+0000","last_change":"2024-04-26T12:14:27.017214+0000","last_active":"2024-04-26T12:14:27.017112+0000","last_peered":"2024-04-26T12:14:27.017112+0000","last_clean":"2024-04-26T12:14:27.017112+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:14:27.017112+0000","last_undegraded":"2024-04-26T12:14:27.017112+0000","last_fullsized":"2024-04-26T12:14:27.017112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_clean_scrub_stamp":"2024-04-26T12:14:27.017091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:37.663928+0000","scrub_duration":0.001639759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478599+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:27.478599+0000","last_peered":"2024-04-26T12:13:27.478599+0000","last_clean":"2024-04-26T12:13:27.478599+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:27.478599+0000","last_undegraded":"2024-04-26T12:13:27.478599+0000","last_fullsized":"2024-04-26T12:13:27.478599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831871+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:28.831871+0000","last_peered":"2024-04-26T12:13:28.831871+0000","last_clean":"2024-04-26T12:13:28.831871+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:28.831871+0000","last_undegraded":"2024-04-26T12:13:28.831871+0000","last_fullsized":"2024-04-26T12:13:28.831871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768118+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768118+0000","last_peered":"2024-04-26T12:13:37.768118+0000","last_clean":"2024-04-26T12:13:37.768118+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768118+0000","last_undegraded":"2024-04-26T12:13:37.768118+0000","last_fullsized":"2024-04-26T12:13:37.768118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477835+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:27.477835+0000","last_peered":"2024-04-26T12:13:27.477835+0000","last_clean":"2024-04-26T12:13:27.477835+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:27.477835+0000","last_undegraded":"2024-04-26T12:13:27.477835+0000","last_fullsized":"2024-04-26T12:13:27.477835+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477719+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:27.477719+0000","last_peered":"2024-04-26T12:13:27.477719+0000","last_clean":"2024-04-26T12:13:27.477719+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:27.477719+0000","last_undegraded":"2024-04-26T12:13:27.477719+0000","last_fullsized":"2024-04-26T12:13:27.477719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477665+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:27.477665+0000","last_peered":"2024-04-26T12:13:27.477665+0000","last_clean":"2024-04-26T12:13:27.477665+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:27.477665+0000","last_undegraded":"2024-04-26T12:13:27.477665+0000","last_fullsized":"2024-04-26T12:13:27.477665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962212+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:35.962212+0000","last_peered":"2024-04-26T12:13:35.962212+0000","last_clean":"2024-04-26T12:13:35.962212+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:35.962212+0000","last_undegraded":"2024-04-26T12:13:35.962212+0000","last_fullsized":"2024-04-26T12:13:35.962212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403676+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:35.403676+0000","last_peered":"2024-04-26T12:13:35.403676+0000","last_clean":"2024-04-26T12:13:35.403676+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:35.403676+0000","last_undegraded":"2024-04-26T12:13:35.403676+0000","last_fullsized":"2024-04-26T12:13:35.403676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:13.303269+0000","last_change":"2024-04-26T12:14:13.303269+0000","last_active":"2024-04-26T12:14:13.303269+0000","last_peered":"2024-04-26T12:14:13.303269+0000","last_clean":"2024-04-26T12:14:13.303269+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:14:13.303269+0000","last_undegraded":"2024-04-26T12:14:13.303269+0000","last_fullsized":"2024-04-26T12:14:13.303269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_clean_scrub_stamp":"2024-04-26T12:14:13.303081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.143477+0000","scrub_duration":0.030270521000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.938926+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.938926+0000","last_peered":"2024-04-26T12:14:06.938926+0000","last_clean":"2024-04-26T12:14:06.938926+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.938926+0000","last_undegraded":"2024-04-26T12:14:06.938926+0000","last_fullsized":"2024-04-26T12:14:06.938926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477350+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:27.477350+0000","last_peered":"2024-04-26T12:13:27.477350+0000","last_clean":"2024-04-26T12:13:27.477350+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:27.477350+0000","last_undegraded":"2024-04-26T12:13:27.477350+0000","last_fullsized":"2024-04-26T12:13:27.477350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945792+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945792+0000","last_peered":"2024-04-26T12:13:55.945792+0000","last_clean":"2024-04-26T12:13:55.945792+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945792+0000","last_undegraded":"2024-04-26T12:13:55.945792+0000","last_fullsized":"2024-04-26T12:13:55.945792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962191+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:35.962191+0000","last_peered":"2024-04-26T12:13:35.962191+0000","last_clean":"2024-04-26T12:13:35.962191+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:35.962191+0000","last_undegraded":"2024-04-26T12:13:35.962191+0000","last_fullsized":"2024-04-26T12:13:35.962191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962164+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:35.962164+0000","last_peered":"2024-04-26T12:13:35.962164+0000","last_clean":"2024-04-26T12:13:35.962164+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:35.962164+0000","last_undegraded":"2024-04-26T12:13:35.962164+0000","last_fullsized":"2024-04-26T12:13:35.962164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478701+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:27.478701+0000","last_peered":"2024-04-26T12:13:27.478701+0000","last_clean":"2024-04-26T12:13:27.478701+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:27.478701+0000","last_undegraded":"2024-04-26T12:13:27.478701+0000","last_fullsized":"2024-04-26T12:13:27.478701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":69,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831629+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:28.831629+0000","last_peered":"2024-04-26T12:13:28.831629+0000","last_clean":"2024-04-26T12:13:28.831629+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:28.831629+0000","last_undegraded":"2024-04-26T12:13:28.831629+0000","last_fullsized":"2024-04-26T12:13:28.831629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963106+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963106+0000","last_peered":"2024-04-26T12:13:54.963106+0000","last_clean":"2024-04-26T12:13:54.963106+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963106+0000","last_undegraded":"2024-04-26T12:13:54.963106+0000","last_fullsized":"2024-04-26T12:13:54.963106+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384494+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384494+0000","last_peered":"2024-04-26T12:13:56.384494+0000","last_clean":"2024-04-26T12:13:56.384494+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384494+0000","last_undegraded":"2024-04-26T12:13:56.384494+0000","last_fullsized":"2024-04-26T12:13:56.384494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962136+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:35.962136+0000","last_peered":"2024-04-26T12:13:35.962136+0000","last_clean":"2024-04-26T12:13:35.962136+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:35.962136+0000","last_undegraded":"2024-04-26T12:13:35.962136+0000","last_fullsized":"2024-04-26T12:13:35.962136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345186+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345186+0000","last_peered":"2024-04-26T12:14:06.345186+0000","last_clean":"2024-04-26T12:14:06.345186+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345186+0000","last_undegraded":"2024-04-26T12:14:06.345186+0000","last_fullsized":"2024-04-26T12:14:06.345186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.973075+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.973075+0000","last_peered":"2024-04-26T12:13:46.973075+0000","last_clean":"2024-04-26T12:13:46.973075+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.973075+0000","last_undegraded":"2024-04-26T12:13:46.973075+0000","last_fullsized":"2024-04-26T12:13:46.973075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:15.275558+0000","last_change":"2024-04-26T12:14:15.275693+0000","last_active":"2024-04-26T12:14:15.275558+0000","last_peered":"2024-04-26T12:14:15.275558+0000","last_clean":"2024-04-26T12:14:15.275558+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:14:15.275558+0000","last_undegraded":"2024-04-26T12:14:15.275558+0000","last_fullsized":"2024-04-26T12:14:15.275558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_clean_scrub_stamp":"2024-04-26T12:14:15.275528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:03.816301+0000","scrub_duration":0.0017978549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448534+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448534+0000","last_peered":"2024-04-26T12:13:40.448534+0000","last_clean":"2024-04-26T12:13:40.448534+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448534+0000","last_undegraded":"2024-04-26T12:13:40.448534+0000","last_fullsized":"2024-04-26T12:13:40.448534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.968945+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.968945+0000","last_peered":"2024-04-26T12:14:08.968945+0000","last_clean":"2024-04-26T12:14:08.968945+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.968945+0000","last_undegraded":"2024-04-26T12:14:08.968945+0000","last_fullsized":"2024-04-26T12:14:08.968945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.429010+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.429010+0000","last_peered":"2024-04-26T12:13:55.429010+0000","last_clean":"2024-04-26T12:13:55.429010+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.429010+0000","last_undegraded":"2024-04-26T12:13:55.429010+0000","last_fullsized":"2024-04-26T12:13:55.429010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.832122+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:28.832122+0000","last_peered":"2024-04-26T12:13:28.832122+0000","last_clean":"2024-04-26T12:13:28.832122+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:28.832122+0000","last_undegraded":"2024-04-26T12:13:28.832122+0000","last_fullsized":"2024-04-26T12:13:28.832122+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448329+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448329+0000","last_peered":"2024-04-26T12:13:38.448329+0000","last_clean":"2024-04-26T12:13:38.448329+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448329+0000","last_undegraded":"2024-04-26T12:13:38.448329+0000","last_fullsized":"2024-04-26T12:13:38.448329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478313+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:27.478313+0000","last_peered":"2024-04-26T12:13:27.478313+0000","last_clean":"2024-04-26T12:13:27.478313+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:27.478313+0000","last_undegraded":"2024-04-26T12:13:27.478313+0000","last_fullsized":"2024-04-26T12:13:27.478313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477609+0000","last_change":"2024-04-26T12:13:14.394050+0000","last_active":"2024-04-26T12:13:27.477609+0000","last_peered":"2024-04-26T12:13:27.477609+0000","last_clean":"2024-04-26T12:13:27.477609+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:13:27.477609+0000","last_undegraded":"2024-04-26T12:13:27.477609+0000","last_fullsized":"2024-04-26T12:13:27.477609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863656+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863656+0000","last_peered":"2024-04-26T12:13:43.863656+0000","last_clean":"2024-04-26T12:13:43.863656+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863656+0000","last_undegraded":"2024-04-26T12:13:43.863656+0000","last_fullsized":"2024-04-26T12:13:43.863656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961840+0000","last_change":"2024-04-26T12:13:14.388181+0000","last_active":"2024-04-26T12:13:35.961840+0000","last_peered":"2024-04-26T12:13:35.961840+0000","last_clean":"2024-04-26T12:13:35.961840+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:13:35.961840+0000","last_undegraded":"2024-04-26T12:13:35.961840+0000","last_fullsized":"2024-04-26T12:13:35.961840+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916371+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916371+0000","last_peered":"2024-04-26T12:13:45.916371+0000","last_clean":"2024-04-26T12:13:45.916371+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916371+0000","last_undegraded":"2024-04-26T12:13:45.916371+0000","last_fullsized":"2024-04-26T12:13:45.916371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994111+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994111+0000","last_peered":"2024-04-26T12:14:11.994111+0000","last_clean":"2024-04-26T12:14:11.994111+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994111+0000","last_undegraded":"2024-04-26T12:14:11.994111+0000","last_fullsized":"2024-04-26T12:14:11.994111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433233+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433233+0000","last_peered":"2024-04-26T12:13:46.433233+0000","last_clean":"2024-04-26T12:13:46.433233+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433233+0000","last_undegraded":"2024-04-26T12:13:46.433233+0000","last_fullsized":"2024-04-26T12:13:46.433233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'12","reported_seq":46,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.841817+0000","last_change":"2024-04-26T12:14:18.841922+0000","last_active":"2024-04-26T12:14:18.841817+0000","last_peered":"2024-04-26T12:14:18.841817+0000","last_clean":"2024-04-26T12:14:18.841817+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:14:18.841817+0000","last_undegraded":"2024-04-26T12:14:18.841817+0000","last_fullsized":"2024-04-26T12:14:18.841817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.841792+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:13.987239+0000","scrub_duration":0.0044348529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":91,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433025+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433025+0000","last_peered":"2024-04-26T12:13:48.433025+0000","last_clean":"2024-04-26T12:13:48.433025+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433025+0000","last_undegraded":"2024-04-26T12:13:48.433025+0000","last_fullsized":"2024-04-26T12:13:48.433025+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478494+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:27.478494+0000","last_peered":"2024-04-26T12:13:27.478494+0000","last_clean":"2024-04-26T12:13:27.478494+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:27.478494+0000","last_undegraded":"2024-04-26T12:13:27.478494+0000","last_fullsized":"2024-04-26T12:13:27.478494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403442+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:35.403442+0000","last_peered":"2024-04-26T12:13:35.403442+0000","last_clean":"2024-04-26T12:13:35.403442+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:35.403442+0000","last_undegraded":"2024-04-26T12:13:35.403442+0000","last_fullsized":"2024-04-26T12:13:35.403442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.959426+0000","last_change":"2024-04-26T12:14:22.959531+0000","last_active":"2024-04-26T12:14:22.959426+0000","last_peered":"2024-04-26T12:14:22.959426+0000","last_clean":"2024-04-26T12:14:22.959426+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:14:22.959426+0000","last_undegraded":"2024-04-26T12:14:22.959426+0000","last_fullsized":"2024-04-26T12:14:22.959426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.959400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.893413+0000","scrub_duration":0.0031299650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403551+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:35.403551+0000","last_peered":"2024-04-26T12:13:35.403551+0000","last_clean":"2024-04-26T12:13:35.403551+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:35.403551+0000","last_undegraded":"2024-04-26T12:13:35.403551+0000","last_fullsized":"2024-04-26T12:13:35.403551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'2","reported_seq":39,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.903710+0000","last_change":"2024-04-26T12:14:12.903851+0000","last_active":"2024-04-26T12:14:12.903710+0000","last_peered":"2024-04-26T12:14:12.903710+0000","last_clean":"2024-04-26T12:14:12.903710+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:14:12.903710+0000","last_undegraded":"2024-04-26T12:14:12.903710+0000","last_fullsized":"2024-04-26T12:14:12.903710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.903685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:26.642032+0000","scrub_duration":0.0032440770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879050+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879050+0000","last_peered":"2024-04-26T12:13:47.879050+0000","last_clean":"2024-04-26T12:13:47.879050+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879050+0000","last_undegraded":"2024-04-26T12:13:47.879050+0000","last_fullsized":"2024-04-26T12:13:47.879050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478446+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:27.478446+0000","last_peered":"2024-04-26T12:13:27.478446+0000","last_clean":"2024-04-26T12:13:27.478446+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:27.478446+0000","last_undegraded":"2024-04-26T12:13:27.478446+0000","last_fullsized":"2024-04-26T12:13:27.478446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.481077+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.481077+0000","last_peered":"2024-04-26T12:13:39.481077+0000","last_clean":"2024-04-26T12:13:39.481077+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.481077+0000","last_undegraded":"2024-04-26T12:13:39.481077+0000","last_fullsized":"2024-04-26T12:13:39.481077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.339693+0000","last_change":"2024-04-26T12:14:22.339818+0000","last_active":"2024-04-26T12:14:22.339693+0000","last_peered":"2024-04-26T12:14:22.339693+0000","last_clean":"2024-04-26T12:14:22.339693+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:14:22.339693+0000","last_undegraded":"2024-04-26T12:14:22.339693+0000","last_fullsized":"2024-04-26T12:14:22.339693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.339667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.273680+0000","scrub_duration":0.003330211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477726+0000","last_change":"2024-04-26T12:13:14.387639+0000","last_active":"2024-04-26T12:13:27.477726+0000","last_peered":"2024-04-26T12:13:27.477726+0000","last_clean":"2024-04-26T12:13:27.477726+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:13:27.477726+0000","last_undegraded":"2024-04-26T12:13:27.477726+0000","last_fullsized":"2024-04-26T12:13:27.477726+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477520+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:27.477520+0000","last_peered":"2024-04-26T12:13:27.477520+0000","last_clean":"2024-04-26T12:13:27.477520+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:27.477520+0000","last_undegraded":"2024-04-26T12:13:27.477520+0000","last_fullsized":"2024-04-26T12:13:27.477520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.864959+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.864959+0000","last_peered":"2024-04-26T12:13:37.864959+0000","last_clean":"2024-04-26T12:13:37.864959+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.864959+0000","last_undegraded":"2024-04-26T12:13:37.864959+0000","last_fullsized":"2024-04-26T12:13:37.864959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403323+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:35.403323+0000","last_peered":"2024-04-26T12:13:35.403323+0000","last_clean":"2024-04-26T12:13:35.403323+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:35.403323+0000","last_undegraded":"2024-04-26T12:13:35.403323+0000","last_fullsized":"2024-04-26T12:13:35.403323+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.824102+0000","last_change":"2024-04-26T12:14:28.824242+0000","last_active":"2024-04-26T12:14:28.824102+0000","last_peered":"2024-04-26T12:14:28.824102+0000","last_clean":"2024-04-26T12:14:28.824102+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:14:28.824102+0000","last_undegraded":"2024-04-26T12:14:28.824102+0000","last_fullsized":"2024-04-26T12:14:28.824102+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.824076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:03.088647+0000","scrub_duration":0.001938574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.943962+0000","last_change":"2024-04-26T12:14:18.944074+0000","last_active":"2024-04-26T12:14:18.943962+0000","last_peered":"2024-04-26T12:14:18.943962+0000","last_clean":"2024-04-26T12:14:18.943962+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:14:18.943962+0000","last_undegraded":"2024-04-26T12:14:18.943962+0000","last_fullsized":"2024-04-26T12:14:18.943962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.943939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:15.950995+0000","scrub_duration":0.001622535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962035+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:35.962035+0000","last_peered":"2024-04-26T12:13:35.962035+0000","last_clean":"2024-04-26T12:13:35.962035+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:35.962035+0000","last_undegraded":"2024-04-26T12:13:35.962035+0000","last_fullsized":"2024-04-26T12:13:35.962035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"71'3","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:26.352731+0000","last_change":"2024-04-26T12:14:26.352850+0000","last_active":"2024-04-26T12:14:26.352731+0000","last_peered":"2024-04-26T12:14:26.352731+0000","last_clean":"2024-04-26T12:14:26.352731+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:14:26.352731+0000","last_undegraded":"2024-04-26T12:14:26.352731+0000","last_fullsized":"2024-04-26T12:14:26.352731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_clean_scrub_stamp":"2024-04-26T12:14:26.352705+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:36.999542+0000","scrub_duration":0.0032761019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":73,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403231+0000","last_change":"2024-04-26T12:09:43.906269+0000","last_active":"2024-04-26T12:13:35.403231+0000","last_peered":"2024-04-26T12:13:35.403231+0000","last_clean":"2024-04-26T12:13:35.403231+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:13:35.403231+0000","last_undegraded":"2024-04-26T12:13:35.403231+0000","last_fullsized":"2024-04-26T12:13:35.403231+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344739+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344739+0000","last_peered":"2024-04-26T12:14:08.344739+0000","last_clean":"2024-04-26T12:14:08.344739+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344739+0000","last_undegraded":"2024-04-26T12:14:08.344739+0000","last_fullsized":"2024-04-26T12:14:08.344739+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403268+0000","last_change":"2024-04-26T12:13:14.394857+0000","last_active":"2024-04-26T12:13:35.403268+0000","last_peered":"2024-04-26T12:13:35.403268+0000","last_clean":"2024-04-26T12:13:35.403268+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:13:35.403268+0000","last_undegraded":"2024-04-26T12:13:35.403268+0000","last_fullsized":"2024-04-26T12:13:35.403268+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'2","reported_seq":95,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.465557+0000","last_change":"2024-04-26T12:14:30.465659+0000","last_active":"2024-04-26T12:14:30.465557+0000","last_peered":"2024-04-26T12:14:30.465557+0000","last_clean":"2024-04-26T12:14:30.465557+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:14:30.465557+0000","last_undegraded":"2024-04-26T12:14:30.465557+0000","last_fullsized":"2024-04-26T12:14:30.465557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.465530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:48.739313+0000","scrub_duration":0.0032107360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985324+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985324+0000","last_peered":"2024-04-26T12:14:02.985324+0000","last_clean":"2024-04-26T12:14:02.985324+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985324+0000","last_undegraded":"2024-04-26T12:14:02.985324+0000","last_fullsized":"2024-04-26T12:14:02.985324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:19.306128+0000","last_change":"2024-04-26T12:14:19.306228+0000","last_active":"2024-04-26T12:14:19.306128+0000","last_peered":"2024-04-26T12:14:19.306128+0000","last_clean":"2024-04-26T12:14:19.306128+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:14:19.306128+0000","last_undegraded":"2024-04-26T12:14:19.306128+0000","last_fullsized":"2024-04-26T12:14:19.306128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_clean_scrub_stamp":"2024-04-26T12:14:19.306105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:16.313160+0000","scrub_duration":0.00185067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":234,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764036+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764036+0000","last_peered":"2024-04-26T12:13:57.764036+0000","last_clean":"2024-04-26T12:13:57.764036+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764036+0000","last_undegraded":"2024-04-26T12:13:57.764036+0000","last_fullsized":"2024-04-26T12:13:57.764036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:20.284951+0000","last_change":"2024-04-26T12:14:20.285067+0000","last_active":"2024-04-26T12:14:20.284951+0000","last_peered":"2024-04-26T12:14:20.284951+0000","last_clean":"2024-04-26T12:14:20.284951+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:14:20.284951+0000","last_undegraded":"2024-04-26T12:14:20.284951+0000","last_fullsized":"2024-04-26T12:14:20.284951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_clean_scrub_stamp":"2024-04-26T12:14:20.284929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:17.159266+0000","scrub_duration":0.0019985570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803306+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803306+0000","last_peered":"2024-04-26T12:13:53.803306+0000","last_clean":"2024-04-26T12:13:53.803306+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803306+0000","last_undegraded":"2024-04-26T12:13:53.803306+0000","last_fullsized":"2024-04-26T12:13:53.803306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403253+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:35.403253+0000","last_peered":"2024-04-26T12:13:35.403253+0000","last_clean":"2024-04-26T12:13:35.403253+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:35.403253+0000","last_undegraded":"2024-04-26T12:13:35.403253+0000","last_fullsized":"2024-04-26T12:13:35.403253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.961954+0000","last_change":"2024-04-26T12:09:49.382956+0000","last_active":"2024-04-26T12:13:35.961954+0000","last_peered":"2024-04-26T12:13:35.961954+0000","last_clean":"2024-04-26T12:13:35.961954+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:13:35.961954+0000","last_undegraded":"2024-04-26T12:13:35.961954+0000","last_fullsized":"2024-04-26T12:13:35.961954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833452+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833452+0000","last_peered":"2024-04-26T12:13:42.833452+0000","last_clean":"2024-04-26T12:13:42.833452+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833452+0000","last_undegraded":"2024-04-26T12:13:42.833452+0000","last_fullsized":"2024-04-26T12:13:42.833452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.332054+0000","last_change":"2024-04-26T12:14:21.332157+0000","last_active":"2024-04-26T12:14:21.332054+0000","last_peered":"2024-04-26T12:14:21.332054+0000","last_clean":"2024-04-26T12:14:21.332054+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:14:21.332054+0000","last_undegraded":"2024-04-26T12:14:21.332054+0000","last_fullsized":"2024-04-26T12:14:21.332054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.332028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.114364+0000","scrub_duration":0.001618303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478156+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:27.478156+0000","last_peered":"2024-04-26T12:13:27.478156+0000","last_clean":"2024-04-26T12:13:27.478156+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:27.478156+0000","last_undegraded":"2024-04-26T12:13:27.478156+0000","last_fullsized":"2024-04-26T12:13:27.478156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.983564+0000","last_change":"2024-04-26T12:14:30.983701+0000","last_active":"2024-04-26T12:14:30.983564+0000","last_peered":"2024-04-26T12:14:30.983564+0000","last_clean":"2024-04-26T12:14:30.983564+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:14:30.983564+0000","last_undegraded":"2024-04-26T12:14:30.983564+0000","last_fullsized":"2024-04-26T12:14:30.983564+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.983541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:49.257324+0000","scrub_duration":0.001498107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477543+0000","last_change":"2024-04-26T12:13:14.394347+0000","last_active":"2024-04-26T12:13:27.477543+0000","last_peered":"2024-04-26T12:13:27.477543+0000","last_clean":"2024-04-26T12:13:27.477543+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:13:27.477543+0000","last_undegraded":"2024-04-26T12:13:27.477543+0000","last_fullsized":"2024-04-26T12:13:27.477543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300236+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300236+0000","last_peered":"2024-04-26T12:14:05.300236+0000","last_clean":"2024-04-26T12:14:05.300236+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300236+0000","last_undegraded":"2024-04-26T12:14:05.300236+0000","last_fullsized":"2024-04-26T12:14:05.300236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403248+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:35.403248+0000","last_peered":"2024-04-26T12:13:35.403248+0000","last_clean":"2024-04-26T12:13:35.403248+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:35.403248+0000","last_undegraded":"2024-04-26T12:13:35.403248+0000","last_fullsized":"2024-04-26T12:13:35.403248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.407944+0000","last_change":"2024-04-26T12:14:28.408043+0000","last_active":"2024-04-26T12:14:28.407944+0000","last_peered":"2024-04-26T12:14:28.407944+0000","last_clean":"2024-04-26T12:14:28.407944+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:14:28.407944+0000","last_undegraded":"2024-04-26T12:14:28.407944+0000","last_fullsized":"2024-04-26T12:14:28.407944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.407919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.310058+0000","scrub_duration":0.0017962410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.995143+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:13:53.995143+0000","last_peered":"2024-04-26T12:13:53.995143+0000","last_clean":"2024-04-26T12:13:53.995143+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:53.995143+0000","last_undegraded":"2024-04-26T12:13:53.995143+0000","last_fullsized":"2024-04-26T12:13:53.995143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.389784+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478450+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:27.478450+0000","last_peered":"2024-04-26T12:13:27.478450+0000","last_clean":"2024-04-26T12:13:27.478450+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:27.478450+0000","last_undegraded":"2024-04-26T12:13:27.478450+0000","last_fullsized":"2024-04-26T12:13:27.478450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403488+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:35.403488+0000","last_peered":"2024-04-26T12:13:35.403488+0000","last_clean":"2024-04-26T12:13:35.403488+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:35.403488+0000","last_undegraded":"2024-04-26T12:13:35.403488+0000","last_fullsized":"2024-04-26T12:13:35.403488+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.987257+0000","last_change":"2024-04-26T12:14:28.987377+0000","last_active":"2024-04-26T12:14:28.987257+0000","last_peered":"2024-04-26T12:14:28.987257+0000","last_clean":"2024-04-26T12:14:28.987257+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:14:28.987257+0000","last_undegraded":"2024-04-26T12:14:28.987257+0000","last_fullsized":"2024-04-26T12:14:28.987257+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.987230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.889368+0000","scrub_duration":0.001924799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":78,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:14.918774+0000","last_change":"2024-04-26T12:14:14.918924+0000","last_active":"2024-04-26T12:14:14.918774+0000","last_peered":"2024-04-26T12:14:14.918774+0000","last_clean":"2024-04-26T12:14:14.918774+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:14:14.918774+0000","last_undegraded":"2024-04-26T12:14:14.918774+0000","last_fullsized":"2024-04-26T12:14:14.918774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_clean_scrub_stamp":"2024-04-26T12:14:14.918752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:08.147282+0000","scrub_duration":0.0020495079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477877+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:27.477877+0000","last_peered":"2024-04-26T12:13:27.477877+0000","last_clean":"2024-04-26T12:13:27.477877+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:27.477877+0000","last_undegraded":"2024-04-26T12:13:27.477877+0000","last_fullsized":"2024-04-26T12:13:27.477877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477975+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:27.477975+0000","last_peered":"2024-04-26T12:13:27.477975+0000","last_clean":"2024-04-26T12:13:27.477975+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:27.477975+0000","last_undegraded":"2024-04-26T12:13:27.477975+0000","last_fullsized":"2024-04-26T12:13:27.477975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'3","reported_seq":48,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.825183+0000","last_change":"2024-04-26T12:14:22.825288+0000","last_active":"2024-04-26T12:14:22.825183+0000","last_peered":"2024-04-26T12:14:22.825183+0000","last_clean":"2024-04-26T12:14:22.825183+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:14:22.825183+0000","last_undegraded":"2024-04-26T12:14:22.825183+0000","last_fullsized":"2024-04-26T12:14:22.825183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.825158+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:07.535329+0000","scrub_duration":0.0029636649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477370+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:27.477370+0000","last_peered":"2024-04-26T12:13:27.477370+0000","last_clean":"2024-04-26T12:13:27.477370+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:27.477370+0000","last_undegraded":"2024-04-26T12:13:27.477370+0000","last_fullsized":"2024-04-26T12:13:27.477370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.233804+0000","last_change":"2024-04-26T12:14:12.233933+0000","last_active":"2024-04-26T12:14:12.233804+0000","last_peered":"2024-04-26T12:14:12.233804+0000","last_clean":"2024-04-26T12:14:12.233804+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:14:12.233804+0000","last_undegraded":"2024-04-26T12:14:12.233804+0000","last_fullsized":"2024-04-26T12:14:12.233804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.233775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:07.781137+0000","scrub_duration":0.0019158669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:28.831634+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:28.831634+0000","last_peered":"2024-04-26T12:13:28.831634+0000","last_clean":"2024-04-26T12:13:28.831634+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:28.831634+0000","last_undegraded":"2024-04-26T12:13:28.831634+0000","last_fullsized":"2024-04-26T12:13:28.831634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":99,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403595+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403595+0000","last_peered":"2024-04-26T12:13:51.403595+0000","last_clean":"2024-04-26T12:13:51.403595+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403595+0000","last_undegraded":"2024-04-26T12:13:51.403595+0000","last_fullsized":"2024-04-26T12:13:51.403595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798515+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798515+0000","last_peered":"2024-04-26T12:13:55.798515+0000","last_clean":"2024-04-26T12:13:55.798515+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798515+0000","last_undegraded":"2024-04-26T12:13:55.798515+0000","last_fullsized":"2024-04-26T12:13:55.798515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477375+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:27.477375+0000","last_peered":"2024-04-26T12:13:27.477375+0000","last_clean":"2024-04-26T12:13:27.477375+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:27.477375+0000","last_undegraded":"2024-04-26T12:13:27.477375+0000","last_fullsized":"2024-04-26T12:13:27.477375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406311+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406311+0000","last_peered":"2024-04-26T12:13:47.406311+0000","last_clean":"2024-04-26T12:13:47.406311+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406311+0000","last_undegraded":"2024-04-26T12:13:47.406311+0000","last_fullsized":"2024-04-26T12:13:47.406311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403544+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:35.403544+0000","last_peered":"2024-04-26T12:13:35.403544+0000","last_clean":"2024-04-26T12:13:35.403544+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:35.403544+0000","last_undegraded":"2024-04-26T12:13:35.403544+0000","last_fullsized":"2024-04-26T12:13:35.403544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962163+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:35.962163+0000","last_peered":"2024-04-26T12:13:35.962163+0000","last_clean":"2024-04-26T12:13:35.962163+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:35.962163+0000","last_undegraded":"2024-04-26T12:13:35.962163+0000","last_fullsized":"2024-04-26T12:13:35.962163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:13:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.36199999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.56699999999999995,"5min":1.504,"15min":1.504},"last":0.378},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52100000000000002,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.55900000000000005,"5min":2.383,"15min":2.383},"last":0.47999999999999998}]}]},{"osd":0,"up_from":64,"seq":274877906962,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.53400000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Apr 26 12:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.35299999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.69099999999999995,"5min":2.214,"15min":2.214},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.505,"15min":0.432},"min":{"1min":0.35899999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.66800000000000004,"5min":2.294,"15min":2.294},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:37.615 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.615 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.615 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.616 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.617 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.618 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.619 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.620 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.621 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.621 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.621 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.621 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.621 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:37.621 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:14:57.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:14:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:14:58.007 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:14:58.018 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-26T12:14:56.944236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895460+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895460+0000","last_peered":"2024-04-26T12:13:40.895460+0000","last_clean":"2024-04-26T12:13:40.895460+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895460+0000","last_undegraded":"2024-04-26T12:13:40.895460+0000","last_fullsized":"2024-04-26T12:13:40.895460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403735+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:35.403735+0000","last_peered":"2024-04-26T12:13:35.403735+0000","last_clean":"2024-04-26T12:13:35.403735+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:35.403735+0000","last_undegraded":"2024-04-26T12:13:35.403735+0000","last_fullsized":"2024-04-26T12:13:35.403735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900330+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900330+0000","last_peered":"2024-04-26T12:13:39.900330+0000","last_clean":"2024-04-26T12:13:39.900330+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900330+0000","last_undegraded":"2024-04-26T12:13:39.900330+0000","last_fullsized":"2024-04-26T12:13:39.900330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478159+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:27.478159+0000","last_peered":"2024-04-26T12:13:27.478159+0000","last_clean":"2024-04-26T12:13:27.478159+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:27.478159+0000","last_undegraded":"2024-04-26T12:13:27.478159+0000","last_fullsized":"2024-04-26T12:13:27.478159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.957122+0000","last_change":"2024-04-26T12:14:21.957122+0000","last_active":"2024-04-26T12:14:21.957122+0000","last_peered":"2024-04-26T12:14:21.957122+0000","last_clean":"2024-04-26T12:14:21.957122+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:14:21.957122+0000","last_undegraded":"2024-04-26T12:14:21.957122+0000","last_fullsized":"2024-04-26T12:14:21.957122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.956989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.739324+0000","scrub_duration":0.017760125000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.857322+0000","last_change":"2024-04-26T12:14:30.857441+0000","last_active":"2024-04-26T12:14:30.857322+0000","last_peered":"2024-04-26T12:14:30.857322+0000","last_clean":"2024-04-26T12:14:30.857322+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:14:30.857322+0000","last_undegraded":"2024-04-26T12:14:30.857322+0000","last_fullsized":"2024-04-26T12:14:30.857322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.857300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:25.197434+0000","scrub_duration":0.0017286269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477296+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:27.477296+0000","last_peered":"2024-04-26T12:13:27.477296+0000","last_clean":"2024-04-26T12:13:27.477296+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:27.477296+0000","last_undegraded":"2024-04-26T12:13:27.477296+0000","last_fullsized":"2024-04-26T12:13:27.477296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476972+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:27.476972+0000","last_peered":"2024-04-26T12:13:27.476972+0000","last_clean":"2024-04-26T12:13:27.476972+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:27.476972+0000","last_undegraded":"2024-04-26T12:13:27.476972+0000","last_fullsized":"2024-04-26T12:13:27.476972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962230+0000","last_change":"2024-04-26T12:09:49.380218+0000","last_active":"2024-04-26T12:13:35.962230+0000","last_peered":"2024-04-26T12:13:35.962230+0000","last_clean":"2024-04-26T12:13:35.962230+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:13:35.962230+0000","last_undegraded":"2024-04-26T12:13:35.962230+0000","last_fullsized":"2024-04-26T12:13:35.962230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:27.017214+0000","last_change":"2024-04-26T12:14:27.017214+0000","last_active":"2024-04-26T12:14:27.017214+0000","last_peered":"2024-04-26T12:14:27.017214+0000","last_clean":"2024-04-26T12:14:27.017214+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:14:27.017214+0000","last_undegraded":"2024-04-26T12:14:27.017214+0000","last_fullsized":"2024-04-26T12:14:27.017214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_clean_scrub_stamp":"2024-04-26T12:14:27.017091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:37.663928+0000","scrub_duration":0.001639759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478599+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:27.478599+0000","last_peered":"2024-04-26T12:13:27.478599+0000","last_clean":"2024-04-26T12:13:27.478599+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:27.478599+0000","last_undegraded":"2024-04-26T12:13:27.478599+0000","last_fullsized":"2024-04-26T12:13:27.478599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403691+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:35.403691+0000","last_peered":"2024-04-26T12:13:35.403691+0000","last_clean":"2024-04-26T12:13:35.403691+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:35.403691+0000","last_undegraded":"2024-04-26T12:13:35.403691+0000","last_fullsized":"2024-04-26T12:13:35.403691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768255+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768255+0000","last_peered":"2024-04-26T12:13:37.768255+0000","last_clean":"2024-04-26T12:13:37.768255+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768255+0000","last_undegraded":"2024-04-26T12:13:37.768255+0000","last_fullsized":"2024-04-26T12:13:37.768255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477835+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:27.477835+0000","last_peered":"2024-04-26T12:13:27.477835+0000","last_clean":"2024-04-26T12:13:27.477835+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:27.477835+0000","last_undegraded":"2024-04-26T12:13:27.477835+0000","last_fullsized":"2024-04-26T12:13:27.477835+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477719+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:27.477719+0000","last_peered":"2024-04-26T12:13:27.477719+0000","last_clean":"2024-04-26T12:13:27.477719+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:27.477719+0000","last_undegraded":"2024-04-26T12:13:27.477719+0000","last_fullsized":"2024-04-26T12:13:27.477719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477665+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:27.477665+0000","last_peered":"2024-04-26T12:13:27.477665+0000","last_clean":"2024-04-26T12:13:27.477665+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:27.477665+0000","last_undegraded":"2024-04-26T12:13:27.477665+0000","last_fullsized":"2024-04-26T12:13:27.477665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962212+0000","last_change":"2024-04-26T12:09:49.380337+0000","last_active":"2024-04-26T12:13:35.962212+0000","last_peered":"2024-04-26T12:13:35.962212+0000","last_clean":"2024-04-26T12:13:35.962212+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:13:35.962212+0000","last_undegraded":"2024-04-26T12:13:35.962212+0000","last_fullsized":"2024-04-26T12:13:35.962212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403676+0000","last_change":"2024-04-26T12:09:49.373776+0000","last_active":"2024-04-26T12:13:35.403676+0000","last_peered":"2024-04-26T12:13:35.403676+0000","last_clean":"2024-04-26T12:13:35.403676+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:13:35.403676+0000","last_undegraded":"2024-04-26T12:13:35.403676+0000","last_fullsized":"2024-04-26T12:13:35.403676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:13.303269+0000","last_change":"2024-04-26T12:14:13.303269+0000","last_active":"2024-04-26T12:14:13.303269+0000","last_peered":"2024-04-26T12:14:13.303269+0000","last_clean":"2024-04-26T12:14:13.303269+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:14:13.303269+0000","last_undegraded":"2024-04-26T12:14:13.303269+0000","last_fullsized":"2024-04-26T12:14:13.303269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_clean_scrub_stamp":"2024-04-26T12:14:13.303081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.143477+0000","scrub_duration":0.030270521000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.938926+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.938926+0000","last_peered":"2024-04-26T12:14:06.938926+0000","last_clean":"2024-04-26T12:14:06.938926+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.938926+0000","last_undegraded":"2024-04-26T12:14:06.938926+0000","last_fullsized":"2024-04-26T12:14:06.938926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477350+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:27.477350+0000","last_peered":"2024-04-26T12:13:27.477350+0000","last_clean":"2024-04-26T12:13:27.477350+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:27.477350+0000","last_undegraded":"2024-04-26T12:13:27.477350+0000","last_fullsized":"2024-04-26T12:13:27.477350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945792+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945792+0000","last_peered":"2024-04-26T12:13:55.945792+0000","last_clean":"2024-04-26T12:13:55.945792+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945792+0000","last_undegraded":"2024-04-26T12:13:55.945792+0000","last_fullsized":"2024-04-26T12:13:55.945792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962191+0000","last_change":"2024-04-26T12:13:14.391708+0000","last_active":"2024-04-26T12:13:35.962191+0000","last_peered":"2024-04-26T12:13:35.962191+0000","last_clean":"2024-04-26T12:13:35.962191+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:13:35.962191+0000","last_undegraded":"2024-04-26T12:13:35.962191+0000","last_fullsized":"2024-04-26T12:13:35.962191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962164+0000","last_change":"2024-04-26T12:13:14.392361+0000","last_active":"2024-04-26T12:13:35.962164+0000","last_peered":"2024-04-26T12:13:35.962164+0000","last_clean":"2024-04-26T12:13:35.962164+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:13:35.962164+0000","last_undegraded":"2024-04-26T12:13:35.962164+0000","last_fullsized":"2024-04-26T12:13:35.962164+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478701+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:27.478701+0000","last_peered":"2024-04-26T12:13:27.478701+0000","last_clean":"2024-04-26T12:13:27.478701+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:27.478701+0000","last_undegraded":"2024-04-26T12:13:27.478701+0000","last_fullsized":"2024-04-26T12:13:27.478701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":70,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403378+0000","last_change":"2024-04-26T12:09:48.931543+0000","last_active":"2024-04-26T12:13:35.403378+0000","last_peered":"2024-04-26T12:13:35.403378+0000","last_clean":"2024-04-26T12:13:35.403378+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:13:35.403378+0000","last_undegraded":"2024-04-26T12:13:35.403378+0000","last_fullsized":"2024-04-26T12:13:35.403378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963249+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963249+0000","last_peered":"2024-04-26T12:13:54.963249+0000","last_clean":"2024-04-26T12:13:54.963249+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963249+0000","last_undegraded":"2024-04-26T12:13:54.963249+0000","last_fullsized":"2024-04-26T12:13:54.963249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384596+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384596+0000","last_peered":"2024-04-26T12:13:56.384596+0000","last_clean":"2024-04-26T12:13:56.384596+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384596+0000","last_undegraded":"2024-04-26T12:13:56.384596+0000","last_fullsized":"2024-04-26T12:13:56.384596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962136+0000","last_change":"2024-04-26T12:13:14.392363+0000","last_active":"2024-04-26T12:13:35.962136+0000","last_peered":"2024-04-26T12:13:35.962136+0000","last_clean":"2024-04-26T12:13:35.962136+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:13:35.962136+0000","last_undegraded":"2024-04-26T12:13:35.962136+0000","last_fullsized":"2024-04-26T12:13:35.962136+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345322+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345322+0000","last_peered":"2024-04-26T12:14:06.345322+0000","last_clean":"2024-04-26T12:14:06.345322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345322+0000","last_undegraded":"2024-04-26T12:14:06.345322+0000","last_fullsized":"2024-04-26T12:14:06.345322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.973075+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.973075+0000","last_peered":"2024-04-26T12:13:46.973075+0000","last_clean":"2024-04-26T12:13:46.973075+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.973075+0000","last_undegraded":"2024-04-26T12:13:46.973075+0000","last_fullsized":"2024-04-26T12:13:46.973075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:15.275693+0000","last_change":"2024-04-26T12:14:15.275693+0000","last_active":"2024-04-26T12:14:15.275693+0000","last_peered":"2024-04-26T12:14:15.275693+0000","last_clean":"2024-04-26T12:14:15.275693+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:14:15.275693+0000","last_undegraded":"2024-04-26T12:14:15.275693+0000","last_fullsized":"2024-04-26T12:14:15.275693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_clean_scrub_stamp":"2024-04-26T12:14:15.275528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:03.816301+0000","scrub_duration":0.0017978549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448534+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448534+0000","last_peered":"2024-04-26T12:13:40.448534+0000","last_clean":"2024-04-26T12:13:40.448534+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448534+0000","last_undegraded":"2024-04-26T12:13:40.448534+0000","last_fullsized":"2024-04-26T12:13:40.448534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.968945+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.968945+0000","last_peered":"2024-04-26T12:14:08.968945+0000","last_clean":"2024-04-26T12:14:08.968945+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.968945+0000","last_undegraded":"2024-04-26T12:14:08.968945+0000","last_fullsized":"2024-04-26T12:14:08.968945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.429010+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.429010+0000","last_peered":"2024-04-26T12:13:55.429010+0000","last_clean":"2024-04-26T12:13:55.429010+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.429010+0000","last_undegraded":"2024-04-26T12:13:55.429010+0000","last_fullsized":"2024-04-26T12:13:55.429010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":85,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403344+0000","last_change":"2024-04-26T12:13:14.394950+0000","last_active":"2024-04-26T12:13:35.403344+0000","last_peered":"2024-04-26T12:13:35.403344+0000","last_clean":"2024-04-26T12:13:35.403344+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:13:35.403344+0000","last_undegraded":"2024-04-26T12:13:35.403344+0000","last_fullsized":"2024-04-26T12:13:35.403344+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448329+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448329+0000","last_peered":"2024-04-26T12:13:38.448329+0000","last_clean":"2024-04-26T12:13:38.448329+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448329+0000","last_undegraded":"2024-04-26T12:13:38.448329+0000","last_fullsized":"2024-04-26T12:13:38.448329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478313+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:27.478313+0000","last_peered":"2024-04-26T12:13:27.478313+0000","last_clean":"2024-04-26T12:13:27.478313+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:27.478313+0000","last_undegraded":"2024-04-26T12:13:27.478313+0000","last_fullsized":"2024-04-26T12:13:27.478313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'4","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:33.842718+0000","last_change":"2024-04-26T12:14:33.842822+0000","last_active":"2024-04-26T12:14:33.842718+0000","last_peered":"2024-04-26T12:14:33.842718+0000","last_clean":"2024-04-26T12:14:33.842718+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:14:33.842718+0000","last_undegraded":"2024-04-26T12:14:33.842718+0000","last_fullsized":"2024-04-26T12:14:33.842718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_clean_scrub_stamp":"2024-04-26T12:14:33.842693+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:46.697373+0000","scrub_duration":0.0037628990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863656+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863656+0000","last_peered":"2024-04-26T12:13:43.863656+0000","last_clean":"2024-04-26T12:13:43.863656+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863656+0000","last_undegraded":"2024-04-26T12:13:43.863656+0000","last_fullsized":"2024-04-26T12:13:43.863656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.368067+0000","last_change":"2024-04-26T12:14:35.368170+0000","last_active":"2024-04-26T12:14:35.368067+0000","last_peered":"2024-04-26T12:14:35.368067+0000","last_clean":"2024-04-26T12:14:35.368067+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:14:35.368067+0000","last_undegraded":"2024-04-26T12:14:35.368067+0000","last_fullsized":"2024-04-26T12:14:35.368067+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.368043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:47.502525+0000","scrub_duration":0.001810372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916478+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916478+0000","last_peered":"2024-04-26T12:13:45.916478+0000","last_clean":"2024-04-26T12:13:45.916478+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916478+0000","last_undegraded":"2024-04-26T12:13:45.916478+0000","last_fullsized":"2024-04-26T12:13:45.916478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994111+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994111+0000","last_peered":"2024-04-26T12:14:11.994111+0000","last_clean":"2024-04-26T12:14:11.994111+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994111+0000","last_undegraded":"2024-04-26T12:14:11.994111+0000","last_fullsized":"2024-04-26T12:14:11.994111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433336+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433336+0000","last_peered":"2024-04-26T12:13:46.433336+0000","last_clean":"2024-04-26T12:13:46.433336+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433336+0000","last_undegraded":"2024-04-26T12:13:46.433336+0000","last_fullsized":"2024-04-26T12:13:46.433336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'12","reported_seq":46,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.841817+0000","last_change":"2024-04-26T12:14:18.841922+0000","last_active":"2024-04-26T12:14:18.841817+0000","last_peered":"2024-04-26T12:14:18.841817+0000","last_clean":"2024-04-26T12:14:18.841817+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:14:18.841817+0000","last_undegraded":"2024-04-26T12:14:18.841817+0000","last_fullsized":"2024-04-26T12:14:18.841817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.841792+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:13.987239+0000","scrub_duration":0.0044348529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433157+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433157+0000","last_peered":"2024-04-26T12:13:48.433157+0000","last_clean":"2024-04-26T12:13:48.433157+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433157+0000","last_undegraded":"2024-04-26T12:13:48.433157+0000","last_fullsized":"2024-04-26T12:13:48.433157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478494+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:27.478494+0000","last_peered":"2024-04-26T12:13:27.478494+0000","last_clean":"2024-04-26T12:13:27.478494+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:27.478494+0000","last_undegraded":"2024-04-26T12:13:27.478494+0000","last_fullsized":"2024-04-26T12:13:27.478494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403442+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:35.403442+0000","last_peered":"2024-04-26T12:13:35.403442+0000","last_clean":"2024-04-26T12:13:35.403442+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:35.403442+0000","last_undegraded":"2024-04-26T12:13:35.403442+0000","last_fullsized":"2024-04-26T12:13:35.403442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.959426+0000","last_change":"2024-04-26T12:14:22.959531+0000","last_active":"2024-04-26T12:14:22.959426+0000","last_peered":"2024-04-26T12:14:22.959426+0000","last_clean":"2024-04-26T12:14:22.959426+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:14:22.959426+0000","last_undegraded":"2024-04-26T12:14:22.959426+0000","last_fullsized":"2024-04-26T12:14:22.959426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.959400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.893413+0000","scrub_duration":0.0031299650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403551+0000","last_change":"2024-04-26T12:09:49.372542+0000","last_active":"2024-04-26T12:13:35.403551+0000","last_peered":"2024-04-26T12:13:35.403551+0000","last_clean":"2024-04-26T12:13:35.403551+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:13:35.403551+0000","last_undegraded":"2024-04-26T12:13:35.403551+0000","last_fullsized":"2024-04-26T12:13:35.403551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'2","reported_seq":39,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.903710+0000","last_change":"2024-04-26T12:14:12.903851+0000","last_active":"2024-04-26T12:14:12.903710+0000","last_peered":"2024-04-26T12:14:12.903710+0000","last_clean":"2024-04-26T12:14:12.903710+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:14:12.903710+0000","last_undegraded":"2024-04-26T12:14:12.903710+0000","last_fullsized":"2024-04-26T12:14:12.903710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.903685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:26.642032+0000","scrub_duration":0.0032440770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879050+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879050+0000","last_peered":"2024-04-26T12:13:47.879050+0000","last_clean":"2024-04-26T12:13:47.879050+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879050+0000","last_undegraded":"2024-04-26T12:13:47.879050+0000","last_fullsized":"2024-04-26T12:13:47.879050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478446+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:27.478446+0000","last_peered":"2024-04-26T12:13:27.478446+0000","last_clean":"2024-04-26T12:13:27.478446+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:27.478446+0000","last_undegraded":"2024-04-26T12:13:27.478446+0000","last_fullsized":"2024-04-26T12:13:27.478446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.481077+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.481077+0000","last_peered":"2024-04-26T12:13:39.481077+0000","last_clean":"2024-04-26T12:13:39.481077+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.481077+0000","last_undegraded":"2024-04-26T12:13:39.481077+0000","last_fullsized":"2024-04-26T12:13:39.481077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.339693+0000","last_change":"2024-04-26T12:14:22.339818+0000","last_active":"2024-04-26T12:14:22.339693+0000","last_peered":"2024-04-26T12:14:22.339693+0000","last_clean":"2024-04-26T12:14:22.339693+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:14:22.339693+0000","last_undegraded":"2024-04-26T12:14:22.339693+0000","last_fullsized":"2024-04-26T12:14:22.339693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.339667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.273680+0000","scrub_duration":0.003330211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.889273+0000","last_change":"2024-04-26T12:14:35.889408+0000","last_active":"2024-04-26T12:14:35.889273+0000","last_peered":"2024-04-26T12:14:35.889273+0000","last_clean":"2024-04-26T12:14:35.889273+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:14:35.889273+0000","last_undegraded":"2024-04-26T12:14:35.889273+0000","last_fullsized":"2024-04-26T12:14:35.889273+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.889249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.444942+0000","scrub_duration":0.0023221090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477520+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:27.477520+0000","last_peered":"2024-04-26T12:13:27.477520+0000","last_clean":"2024-04-26T12:13:27.477520+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:27.477520+0000","last_undegraded":"2024-04-26T12:13:27.477520+0000","last_fullsized":"2024-04-26T12:13:27.477520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.864959+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.864959+0000","last_peered":"2024-04-26T12:13:37.864959+0000","last_clean":"2024-04-26T12:13:37.864959+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.864959+0000","last_undegraded":"2024-04-26T12:13:37.864959+0000","last_fullsized":"2024-04-26T12:13:37.864959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403323+0000","last_change":"2024-04-26T12:13:14.392931+0000","last_active":"2024-04-26T12:13:35.403323+0000","last_peered":"2024-04-26T12:13:35.403323+0000","last_clean":"2024-04-26T12:13:35.403323+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:13:35.403323+0000","last_undegraded":"2024-04-26T12:13:35.403323+0000","last_fullsized":"2024-04-26T12:13:35.403323+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.824102+0000","last_change":"2024-04-26T12:14:28.824242+0000","last_active":"2024-04-26T12:14:28.824102+0000","last_peered":"2024-04-26T12:14:28.824102+0000","last_clean":"2024-04-26T12:14:28.824102+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:14:28.824102+0000","last_undegraded":"2024-04-26T12:14:28.824102+0000","last_fullsized":"2024-04-26T12:14:28.824102+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.824076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:03.088647+0000","scrub_duration":0.001938574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.943962+0000","last_change":"2024-04-26T12:14:18.944074+0000","last_active":"2024-04-26T12:14:18.943962+0000","last_peered":"2024-04-26T12:14:18.943962+0000","last_clean":"2024-04-26T12:14:18.943962+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:14:18.943962+0000","last_undegraded":"2024-04-26T12:14:18.943962+0000","last_fullsized":"2024-04-26T12:14:18.943962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.943939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:15.950995+0000","scrub_duration":0.001622535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962035+0000","last_change":"2024-04-26T12:09:49.381533+0000","last_active":"2024-04-26T12:13:35.962035+0000","last_peered":"2024-04-26T12:13:35.962035+0000","last_clean":"2024-04-26T12:13:35.962035+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:13:35.962035+0000","last_undegraded":"2024-04-26T12:13:35.962035+0000","last_fullsized":"2024-04-26T12:13:35.962035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"71'3","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:26.352731+0000","last_change":"2024-04-26T12:14:26.352850+0000","last_active":"2024-04-26T12:14:26.352731+0000","last_peered":"2024-04-26T12:14:26.352731+0000","last_clean":"2024-04-26T12:14:26.352731+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:14:26.352731+0000","last_undegraded":"2024-04-26T12:14:26.352731+0000","last_fullsized":"2024-04-26T12:14:26.352731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_clean_scrub_stamp":"2024-04-26T12:14:26.352705+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:36.999542+0000","scrub_duration":0.0032761019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.970459+0000","last_change":"2024-04-26T12:14:35.970590+0000","last_active":"2024-04-26T12:14:35.970459+0000","last_peered":"2024-04-26T12:14:35.970459+0000","last_clean":"2024-04-26T12:14:35.970459+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:14:35.970459+0000","last_undegraded":"2024-04-26T12:14:35.970459+0000","last_fullsized":"2024-04-26T12:14:35.970459+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.970433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:48.104915+0000","scrub_duration":0.0018752809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344739+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344739+0000","last_peered":"2024-04-26T12:14:08.344739+0000","last_clean":"2024-04-26T12:14:08.344739+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344739+0000","last_undegraded":"2024-04-26T12:14:08.344739+0000","last_fullsized":"2024-04-26T12:14:08.344739+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.943214+0000","last_change":"2024-04-26T12:14:50.943331+0000","last_active":"2024-04-26T12:14:50.943214+0000","last_peered":"2024-04-26T12:14:50.943214+0000","last_clean":"2024-04-26T12:14:50.943214+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:14:50.943214+0000","last_undegraded":"2024-04-26T12:14:50.943214+0000","last_fullsized":"2024-04-26T12:14:50.943214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.943190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.740367+0000","scrub_duration":0.001687745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'2","reported_seq":95,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.465557+0000","last_change":"2024-04-26T12:14:30.465659+0000","last_active":"2024-04-26T12:14:30.465557+0000","last_peered":"2024-04-26T12:14:30.465557+0000","last_clean":"2024-04-26T12:14:30.465557+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:14:30.465557+0000","last_undegraded":"2024-04-26T12:14:30.465557+0000","last_fullsized":"2024-04-26T12:14:30.465557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.465530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:48.739313+0000","scrub_duration":0.0032107360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985324+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985324+0000","last_peered":"2024-04-26T12:14:02.985324+0000","last_clean":"2024-04-26T12:14:02.985324+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985324+0000","last_undegraded":"2024-04-26T12:14:02.985324+0000","last_fullsized":"2024-04-26T12:14:02.985324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:19.306128+0000","last_change":"2024-04-26T12:14:19.306228+0000","last_active":"2024-04-26T12:14:19.306128+0000","last_peered":"2024-04-26T12:14:19.306128+0000","last_clean":"2024-04-26T12:14:19.306128+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:14:19.306128+0000","last_undegraded":"2024-04-26T12:14:19.306128+0000","last_fullsized":"2024-04-26T12:14:19.306128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_clean_scrub_stamp":"2024-04-26T12:14:19.306105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:16.313160+0000","scrub_duration":0.00185067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":234,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764036+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764036+0000","last_peered":"2024-04-26T12:13:57.764036+0000","last_clean":"2024-04-26T12:13:57.764036+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764036+0000","last_undegraded":"2024-04-26T12:13:57.764036+0000","last_fullsized":"2024-04-26T12:13:57.764036+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:20.284951+0000","last_change":"2024-04-26T12:14:20.285067+0000","last_active":"2024-04-26T12:14:20.284951+0000","last_peered":"2024-04-26T12:14:20.284951+0000","last_clean":"2024-04-26T12:14:20.284951+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:14:20.284951+0000","last_undegraded":"2024-04-26T12:14:20.284951+0000","last_fullsized":"2024-04-26T12:14:20.284951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_clean_scrub_stamp":"2024-04-26T12:14:20.284929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:17.159266+0000","scrub_duration":0.0019985570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803306+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803306+0000","last_peered":"2024-04-26T12:13:53.803306+0000","last_clean":"2024-04-26T12:13:53.803306+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803306+0000","last_undegraded":"2024-04-26T12:13:53.803306+0000","last_fullsized":"2024-04-26T12:13:53.803306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403253+0000","last_change":"2024-04-26T12:13:14.393403+0000","last_active":"2024-04-26T12:13:35.403253+0000","last_peered":"2024-04-26T12:13:35.403253+0000","last_clean":"2024-04-26T12:13:35.403253+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:13:35.403253+0000","last_undegraded":"2024-04-26T12:13:35.403253+0000","last_fullsized":"2024-04-26T12:13:35.403253+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.463778+0000","last_change":"2024-04-26T12:14:50.463905+0000","last_active":"2024-04-26T12:14:50.463778+0000","last_peered":"2024-04-26T12:14:50.463778+0000","last_clean":"2024-04-26T12:14:50.463778+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:14:50.463778+0000","last_undegraded":"2024-04-26T12:14:50.463778+0000","last_fullsized":"2024-04-26T12:14:50.463778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.463714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.260891+0000","scrub_duration":0.030635608000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833452+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833452+0000","last_peered":"2024-04-26T12:13:42.833452+0000","last_clean":"2024-04-26T12:13:42.833452+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833452+0000","last_undegraded":"2024-04-26T12:13:42.833452+0000","last_fullsized":"2024-04-26T12:13:42.833452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.332054+0000","last_change":"2024-04-26T12:14:21.332157+0000","last_active":"2024-04-26T12:14:21.332054+0000","last_peered":"2024-04-26T12:14:21.332054+0000","last_clean":"2024-04-26T12:14:21.332054+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:14:21.332054+0000","last_undegraded":"2024-04-26T12:14:21.332054+0000","last_fullsized":"2024-04-26T12:14:21.332054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.332028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.114364+0000","scrub_duration":0.001618303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478156+0000","last_change":"2024-04-26T12:13:14.388509+0000","last_active":"2024-04-26T12:13:27.478156+0000","last_peered":"2024-04-26T12:13:27.478156+0000","last_clean":"2024-04-26T12:13:27.478156+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:13:27.478156+0000","last_undegraded":"2024-04-26T12:13:27.478156+0000","last_fullsized":"2024-04-26T12:13:27.478156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.983564+0000","last_change":"2024-04-26T12:14:30.983701+0000","last_active":"2024-04-26T12:14:30.983564+0000","last_peered":"2024-04-26T12:14:30.983564+0000","last_clean":"2024-04-26T12:14:30.983564+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:14:30.983564+0000","last_undegraded":"2024-04-26T12:14:30.983564+0000","last_fullsized":"2024-04-26T12:14:30.983564+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.983541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:49.257324+0000","scrub_duration":0.001498107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.891791+0000","last_change":"2024-04-26T12:14:40.891919+0000","last_active":"2024-04-26T12:14:40.891791+0000","last_peered":"2024-04-26T12:14:40.891791+0000","last_clean":"2024-04-26T12:14:40.891791+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:14:40.891791+0000","last_undegraded":"2024-04-26T12:14:40.891791+0000","last_fullsized":"2024-04-26T12:14:40.891791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_clean_scrub_stamp":"2024-04-26T12:14:40.891766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:11.805668+0000","scrub_duration":0.0015939929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300236+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300236+0000","last_peered":"2024-04-26T12:14:05.300236+0000","last_clean":"2024-04-26T12:14:05.300236+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300236+0000","last_undegraded":"2024-04-26T12:14:05.300236+0000","last_fullsized":"2024-04-26T12:14:05.300236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403248+0000","last_change":"2024-04-26T12:13:14.391514+0000","last_active":"2024-04-26T12:13:35.403248+0000","last_peered":"2024-04-26T12:13:35.403248+0000","last_clean":"2024-04-26T12:13:35.403248+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:13:35.403248+0000","last_undegraded":"2024-04-26T12:13:35.403248+0000","last_fullsized":"2024-04-26T12:13:35.403248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:42.899434+0000","last_clean_scrub_stamp":"2024-04-26T12:09:42.899434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.407944+0000","last_change":"2024-04-26T12:14:28.408043+0000","last_active":"2024-04-26T12:14:28.407944+0000","last_peered":"2024-04-26T12:14:28.407944+0000","last_clean":"2024-04-26T12:14:28.407944+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:14:28.407944+0000","last_undegraded":"2024-04-26T12:14:28.407944+0000","last_fullsized":"2024-04-26T12:14:28.407944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.407919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.310058+0000","scrub_duration":0.0017962410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.995143+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:13:53.995143+0000","last_peered":"2024-04-26T12:13:53.995143+0000","last_clean":"2024-04-26T12:13:53.995143+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:53.995143+0000","last_undegraded":"2024-04-26T12:13:53.995143+0000","last_fullsized":"2024-04-26T12:13:53.995143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:41.919441+0000","last_change":"2024-04-26T12:14:41.919576+0000","last_active":"2024-04-26T12:14:41.919441+0000","last_peered":"2024-04-26T12:14:41.919441+0000","last_clean":"2024-04-26T12:14:41.919441+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:14:41.919441+0000","last_undegraded":"2024-04-26T12:14:41.919441+0000","last_fullsized":"2024-04-26T12:14:41.919441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.919408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:23.254496+0000","scrub_duration":0.002109872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478450+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:27.478450+0000","last_peered":"2024-04-26T12:13:27.478450+0000","last_clean":"2024-04-26T12:13:27.478450+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:27.478450+0000","last_undegraded":"2024-04-26T12:13:27.478450+0000","last_fullsized":"2024-04-26T12:13:27.478450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403488+0000","last_change":"2024-04-26T12:13:14.394443+0000","last_active":"2024-04-26T12:13:35.403488+0000","last_peered":"2024-04-26T12:13:35.403488+0000","last_clean":"2024-04-26T12:13:35.403488+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:13:35.403488+0000","last_undegraded":"2024-04-26T12:13:35.403488+0000","last_fullsized":"2024-04-26T12:13:35.403488+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.987377+0000","last_change":"2024-04-26T12:14:28.987377+0000","last_active":"2024-04-26T12:14:28.987377+0000","last_peered":"2024-04-26T12:14:28.987377+0000","last_clean":"2024-04-26T12:14:28.987377+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:14:28.987377+0000","last_undegraded":"2024-04-26T12:14:28.987377+0000","last_fullsized":"2024-04-26T12:14:28.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.987230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.889368+0000","scrub_duration":0.001924799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:14.918924+0000","last_change":"2024-04-26T12:14:14.918924+0000","last_active":"2024-04-26T12:14:14.918924+0000","last_peered":"2024-04-26T12:14:14.918924+0000","last_clean":"2024-04-26T12:14:14.918924+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:14:14.918924+0000","last_undegraded":"2024-04-26T12:14:14.918924+0000","last_fullsized":"2024-04-26T12:14:14.918924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_clean_scrub_stamp":"2024-04-26T12:14:14.918752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:08.147282+0000","scrub_duration":0.0020495079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477877+0000","last_change":"2024-04-26T12:13:14.391019+0000","last_active":"2024-04-26T12:13:27.477877+0000","last_peered":"2024-04-26T12:13:27.477877+0000","last_clean":"2024-04-26T12:13:27.477877+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:13:27.477877+0000","last_undegraded":"2024-04-26T12:13:27.477877+0000","last_fullsized":"2024-04-26T12:13:27.477877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477975+0000","last_change":"2024-04-26T12:13:14.394121+0000","last_active":"2024-04-26T12:13:27.477975+0000","last_peered":"2024-04-26T12:13:27.477975+0000","last_clean":"2024-04-26T12:13:27.477975+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:13:27.477975+0000","last_undegraded":"2024-04-26T12:13:27.477975+0000","last_fullsized":"2024-04-26T12:13:27.477975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'3","reported_seq":48,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.825183+0000","last_change":"2024-04-26T12:14:22.825288+0000","last_active":"2024-04-26T12:14:22.825183+0000","last_peered":"2024-04-26T12:14:22.825183+0000","last_clean":"2024-04-26T12:14:22.825183+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:14:22.825183+0000","last_undegraded":"2024-04-26T12:14:22.825183+0000","last_fullsized":"2024-04-26T12:14:22.825183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.825158+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:07.535329+0000","scrub_duration":0.0029636649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477370+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:27.477370+0000","last_peered":"2024-04-26T12:13:27.477370+0000","last_clean":"2024-04-26T12:13:27.477370+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:27.477370+0000","last_undegraded":"2024-04-26T12:13:27.477370+0000","last_fullsized":"2024-04-26T12:13:27.477370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.233804+0000","last_change":"2024-04-26T12:14:12.233933+0000","last_active":"2024-04-26T12:14:12.233804+0000","last_peered":"2024-04-26T12:14:12.233804+0000","last_clean":"2024-04-26T12:14:12.233804+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:14:12.233804+0000","last_undegraded":"2024-04-26T12:14:12.233804+0000","last_fullsized":"2024-04-26T12:14:12.233804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.233775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:07.781137+0000","scrub_duration":0.0019158669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403562+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:35.403562+0000","last_peered":"2024-04-26T12:13:35.403562+0000","last_clean":"2024-04-26T12:13:35.403562+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:35.403562+0000","last_undegraded":"2024-04-26T12:13:35.403562+0000","last_fullsized":"2024-04-26T12:13:35.403562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":99,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403595+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403595+0000","last_peered":"2024-04-26T12:13:51.403595+0000","last_clean":"2024-04-26T12:13:51.403595+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403595+0000","last_undegraded":"2024-04-26T12:13:51.403595+0000","last_fullsized":"2024-04-26T12:13:51.403595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798515+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798515+0000","last_peered":"2024-04-26T12:13:55.798515+0000","last_clean":"2024-04-26T12:13:55.798515+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798515+0000","last_undegraded":"2024-04-26T12:13:55.798515+0000","last_fullsized":"2024-04-26T12:13:55.798515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477375+0000","last_change":"2024-04-26T12:13:14.388613+0000","last_active":"2024-04-26T12:13:27.477375+0000","last_peered":"2024-04-26T12:13:27.477375+0000","last_clean":"2024-04-26T12:13:27.477375+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:13:27.477375+0000","last_undegraded":"2024-04-26T12:13:27.477375+0000","last_fullsized":"2024-04-26T12:13:27.477375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406311+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406311+0000","last_peered":"2024-04-26T12:13:47.406311+0000","last_clean":"2024-04-26T12:13:47.406311+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406311+0000","last_undegraded":"2024-04-26T12:13:47.406311+0000","last_fullsized":"2024-04-26T12:13:47.406311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403544+0000","last_change":"2024-04-26T12:13:14.394487+0000","last_active":"2024-04-26T12:13:35.403544+0000","last_peered":"2024-04-26T12:13:35.403544+0000","last_clean":"2024-04-26T12:13:35.403544+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:13:35.403544+0000","last_undegraded":"2024-04-26T12:13:35.403544+0000","last_fullsized":"2024-04-26T12:13:35.403544+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.962163+0000","last_change":"2024-04-26T12:09:49.379403+0000","last_active":"2024-04-26T12:13:35.962163+0000","last_peered":"2024-04-26T12:13:35.962163+0000","last_clean":"2024-04-26T12:13:35.962163+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:13:35.962163+0000","last_undegraded":"2024-04-26T12:13:35.962163+0000","last_fullsized":"2024-04-26T12:13:35.962163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:13:54 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.36199999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.56699999999999995,"5min":1.504,"15min":1.504},"last":0.623},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.52100000000000002,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.55900000000000005,"5min":2.383,"15min":2.383},"last":0.52800000000000002}]}]},{"osd":0,"up_from":64,"seq":274877906966,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Apr 26 12:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.53600000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.35299999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.69099999999999995,"5min":2.214,"15min":2.214},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.505,"15min":0.432},"min":{"1min":0.35899999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.66800000000000004,"5min":2.294,"15min":2.294},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:14:58.023 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.023 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.023 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.023 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.023 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.023 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.024 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.025 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.026 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-26T12:09:42.899434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.027 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:14:58.028 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:15:18.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:15:18.410 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:15:18.411 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:15:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-04-26T12:15:16.949173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895460+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895460+0000","last_peered":"2024-04-26T12:13:40.895460+0000","last_clean":"2024-04-26T12:13:40.895460+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895460+0000","last_undegraded":"2024-04-26T12:13:40.895460+0000","last_fullsized":"2024-04-26T12:13:40.895460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403735+0000","last_change":"2024-04-26T12:09:49.378960+0000","last_active":"2024-04-26T12:13:35.403735+0000","last_peered":"2024-04-26T12:13:35.403735+0000","last_clean":"2024-04-26T12:13:35.403735+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:13:35.403735+0000","last_undegraded":"2024-04-26T12:13:35.403735+0000","last_fullsized":"2024-04-26T12:13:35.403735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900330+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900330+0000","last_peered":"2024-04-26T12:13:39.900330+0000","last_clean":"2024-04-26T12:13:39.900330+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900330+0000","last_undegraded":"2024-04-26T12:13:39.900330+0000","last_fullsized":"2024-04-26T12:13:39.900330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845736+0000","last_change":"2024-04-26T12:13:14.391061+0000","last_active":"2024-04-26T12:13:34.845736+0000","last_peered":"2024-04-26T12:13:34.845736+0000","last_clean":"2024-04-26T12:13:34.845736+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:13:34.845736+0000","last_undegraded":"2024-04-26T12:13:34.845736+0000","last_fullsized":"2024-04-26T12:13:34.845736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.957122+0000","last_change":"2024-04-26T12:14:21.957122+0000","last_active":"2024-04-26T12:14:21.957122+0000","last_peered":"2024-04-26T12:14:21.957122+0000","last_clean":"2024-04-26T12:14:21.957122+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:14:21.957122+0000","last_undegraded":"2024-04-26T12:14:21.957122+0000","last_fullsized":"2024-04-26T12:14:21.957122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.956989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.739324+0000","scrub_duration":0.017760125000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.857322+0000","last_change":"2024-04-26T12:14:30.857441+0000","last_active":"2024-04-26T12:14:30.857322+0000","last_peered":"2024-04-26T12:14:30.857322+0000","last_clean":"2024-04-26T12:14:30.857322+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:14:30.857322+0000","last_undegraded":"2024-04-26T12:14:30.857322+0000","last_fullsized":"2024-04-26T12:14:30.857322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.857300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:25.197434+0000","scrub_duration":0.0017286269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477296+0000","last_change":"2024-04-26T12:13:14.386406+0000","last_active":"2024-04-26T12:13:27.477296+0000","last_peered":"2024-04-26T12:13:27.477296+0000","last_clean":"2024-04-26T12:13:27.477296+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:13:27.477296+0000","last_undegraded":"2024-04-26T12:13:27.477296+0000","last_fullsized":"2024-04-26T12:13:27.477296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.476972+0000","last_change":"2024-04-26T12:13:14.389574+0000","last_active":"2024-04-26T12:13:27.476972+0000","last_peered":"2024-04-26T12:13:27.476972+0000","last_clean":"2024-04-26T12:13:27.476972+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:13:27.476972+0000","last_undegraded":"2024-04-26T12:13:27.476972+0000","last_fullsized":"2024-04-26T12:13:27.476972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.234851+0000","last_change":"2024-04-26T12:15:06.234993+0000","last_active":"2024-04-26T12:15:06.234851+0000","last_peered":"2024-04-26T12:15:06.234851+0000","last_clean":"2024-04-26T12:15:06.234851+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:15:06.234851+0000","last_undegraded":"2024-04-26T12:15:06.234851+0000","last_fullsized":"2024-04-26T12:15:06.234851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.234824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:39.262367+0000","scrub_duration":0.03054697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:27.017214+0000","last_change":"2024-04-26T12:14:27.017214+0000","last_active":"2024-04-26T12:14:27.017214+0000","last_peered":"2024-04-26T12:14:27.017214+0000","last_clean":"2024-04-26T12:14:27.017214+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:14:27.017214+0000","last_undegraded":"2024-04-26T12:14:27.017214+0000","last_fullsized":"2024-04-26T12:14:27.017214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_clean_scrub_stamp":"2024-04-26T12:14:27.017091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:37.663928+0000","scrub_duration":0.001639759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478599+0000","last_change":"2024-04-26T12:13:14.393314+0000","last_active":"2024-04-26T12:13:27.478599+0000","last_peered":"2024-04-26T12:13:27.478599+0000","last_clean":"2024-04-26T12:13:27.478599+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:13:27.478599+0000","last_undegraded":"2024-04-26T12:13:27.478599+0000","last_fullsized":"2024-04-26T12:13:27.478599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403691+0000","last_change":"2024-04-26T12:13:14.394618+0000","last_active":"2024-04-26T12:13:35.403691+0000","last_peered":"2024-04-26T12:13:35.403691+0000","last_clean":"2024-04-26T12:13:35.403691+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:13:35.403691+0000","last_undegraded":"2024-04-26T12:13:35.403691+0000","last_fullsized":"2024-04-26T12:13:35.403691+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768255+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768255+0000","last_peered":"2024-04-26T12:13:37.768255+0000","last_clean":"2024-04-26T12:13:37.768255+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768255+0000","last_undegraded":"2024-04-26T12:13:37.768255+0000","last_fullsized":"2024-04-26T12:13:37.768255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477835+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:27.477835+0000","last_peered":"2024-04-26T12:13:27.477835+0000","last_clean":"2024-04-26T12:13:27.477835+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:27.477835+0000","last_undegraded":"2024-04-26T12:13:27.477835+0000","last_fullsized":"2024-04-26T12:13:27.477835+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477719+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:27.477719+0000","last_peered":"2024-04-26T12:13:27.477719+0000","last_clean":"2024-04-26T12:13:27.477719+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:27.477719+0000","last_undegraded":"2024-04-26T12:13:27.477719+0000","last_fullsized":"2024-04-26T12:13:27.477719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477665+0000","last_change":"2024-04-26T12:13:14.387920+0000","last_active":"2024-04-26T12:13:27.477665+0000","last_peered":"2024-04-26T12:13:27.477665+0000","last_clean":"2024-04-26T12:13:27.477665+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:13:27.477665+0000","last_undegraded":"2024-04-26T12:13:27.477665+0000","last_fullsized":"2024-04-26T12:13:27.477665+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:04.332453+0000","last_change":"2024-04-26T12:15:04.332686+0000","last_active":"2024-04-26T12:15:04.332453+0000","last_peered":"2024-04-26T12:15:04.332453+0000","last_clean":"2024-04-26T12:15:04.332453+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:15:04.332453+0000","last_undegraded":"2024-04-26T12:15:04.332453+0000","last_fullsized":"2024-04-26T12:15:04.332453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_clean_scrub_stamp":"2024-04-26T12:15:04.332430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:30.932618+0000","scrub_duration":0.085013177999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:07.011617+0000","last_change":"2024-04-26T12:15:07.011766+0000","last_active":"2024-04-26T12:15:07.011617+0000","last_peered":"2024-04-26T12:15:07.011617+0000","last_clean":"2024-04-26T12:15:07.011617+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:15:07.011617+0000","last_undegraded":"2024-04-26T12:15:07.011617+0000","last_fullsized":"2024-04-26T12:15:07.011617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_clean_scrub_stamp":"2024-04-26T12:15:07.011593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:28.154774+0000","scrub_duration":0.0018777920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:13.303269+0000","last_change":"2024-04-26T12:14:13.303269+0000","last_active":"2024-04-26T12:14:13.303269+0000","last_peered":"2024-04-26T12:14:13.303269+0000","last_clean":"2024-04-26T12:14:13.303269+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:14:13.303269+0000","last_undegraded":"2024-04-26T12:14:13.303269+0000","last_fullsized":"2024-04-26T12:14:13.303269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_clean_scrub_stamp":"2024-04-26T12:14:13.303081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.143477+0000","scrub_duration":0.030270521000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.938926+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.938926+0000","last_peered":"2024-04-26T12:14:06.938926+0000","last_clean":"2024-04-26T12:14:06.938926+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.938926+0000","last_undegraded":"2024-04-26T12:14:06.938926+0000","last_fullsized":"2024-04-26T12:14:06.938926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477350+0000","last_change":"2024-04-26T12:13:14.389578+0000","last_active":"2024-04-26T12:13:27.477350+0000","last_peered":"2024-04-26T12:13:27.477350+0000","last_clean":"2024-04-26T12:13:27.477350+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:13:27.477350+0000","last_undegraded":"2024-04-26T12:13:27.477350+0000","last_fullsized":"2024-04-26T12:13:27.477350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945792+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945792+0000","last_peered":"2024-04-26T12:13:55.945792+0000","last_clean":"2024-04-26T12:13:55.945792+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945792+0000","last_undegraded":"2024-04-26T12:13:55.945792+0000","last_fullsized":"2024-04-26T12:13:55.945792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.353952+0000","last_change":"2024-04-26T12:14:56.354059+0000","last_active":"2024-04-26T12:14:56.353952+0000","last_peered":"2024-04-26T12:14:56.353952+0000","last_clean":"2024-04-26T12:14:56.353952+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:14:56.353952+0000","last_undegraded":"2024-04-26T12:14:56.353952+0000","last_fullsized":"2024-04-26T12:14:56.353952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.353928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:28.867805+0000","scrub_duration":0.0017401999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:02.259695+0000","last_change":"2024-04-26T12:15:02.259805+0000","last_active":"2024-04-26T12:15:02.259695+0000","last_peered":"2024-04-26T12:15:02.259695+0000","last_clean":"2024-04-26T12:15:02.259695+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:15:02.259695+0000","last_undegraded":"2024-04-26T12:15:02.259695+0000","last_fullsized":"2024-04-26T12:15:02.259695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_clean_scrub_stamp":"2024-04-26T12:15:02.259669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:17.697891+0000","scrub_duration":0.0016369970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478701+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:27.478701+0000","last_peered":"2024-04-26T12:13:27.478701+0000","last_clean":"2024-04-26T12:13:27.478701+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:27.478701+0000","last_undegraded":"2024-04-26T12:13:27.478701+0000","last_fullsized":"2024-04-26T12:13:27.478701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.065209+0000","last_change":"2024-04-26T12:14:57.065316+0000","last_active":"2024-04-26T12:14:57.065209+0000","last_peered":"2024-04-26T12:14:57.065209+0000","last_clean":"2024-04-26T12:14:57.065209+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:14:57.065209+0000","last_undegraded":"2024-04-26T12:14:57.065209+0000","last_fullsized":"2024-04-26T12:14:57.065209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.065182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:12.857856+0000","scrub_duration":0.001780539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963249+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963249+0000","last_peered":"2024-04-26T12:13:54.963249+0000","last_clean":"2024-04-26T12:13:54.963249+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963249+0000","last_undegraded":"2024-04-26T12:13:54.963249+0000","last_fullsized":"2024-04-26T12:13:54.963249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384596+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384596+0000","last_peered":"2024-04-26T12:13:56.384596+0000","last_clean":"2024-04-26T12:13:56.384596+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384596+0000","last_undegraded":"2024-04-26T12:13:56.384596+0000","last_fullsized":"2024-04-26T12:13:56.384596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.342527+0000","last_change":"2024-04-26T12:14:55.342633+0000","last_active":"2024-04-26T12:14:55.342527+0000","last_peered":"2024-04-26T12:14:55.342527+0000","last_clean":"2024-04-26T12:14:55.342527+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:14:55.342527+0000","last_undegraded":"2024-04-26T12:14:55.342527+0000","last_fullsized":"2024-04-26T12:14:55.342527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.342504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.330593+0000","scrub_duration":0.001697816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345322+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345322+0000","last_peered":"2024-04-26T12:14:06.345322+0000","last_clean":"2024-04-26T12:14:06.345322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345322+0000","last_undegraded":"2024-04-26T12:14:06.345322+0000","last_fullsized":"2024-04-26T12:14:06.345322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.973075+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.973075+0000","last_peered":"2024-04-26T12:13:46.973075+0000","last_clean":"2024-04-26T12:13:46.973075+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.973075+0000","last_undegraded":"2024-04-26T12:13:46.973075+0000","last_fullsized":"2024-04-26T12:13:46.973075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:15.275693+0000","last_change":"2024-04-26T12:14:15.275693+0000","last_active":"2024-04-26T12:14:15.275693+0000","last_peered":"2024-04-26T12:14:15.275693+0000","last_clean":"2024-04-26T12:14:15.275693+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:14:15.275693+0000","last_undegraded":"2024-04-26T12:14:15.275693+0000","last_fullsized":"2024-04-26T12:14:15.275693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_clean_scrub_stamp":"2024-04-26T12:14:15.275528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:03.816301+0000","scrub_duration":0.0017978549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448534+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448534+0000","last_peered":"2024-04-26T12:13:40.448534+0000","last_clean":"2024-04-26T12:13:40.448534+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448534+0000","last_undegraded":"2024-04-26T12:13:40.448534+0000","last_fullsized":"2024-04-26T12:13:40.448534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.968945+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.968945+0000","last_peered":"2024-04-26T12:14:08.968945+0000","last_clean":"2024-04-26T12:14:08.968945+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.968945+0000","last_undegraded":"2024-04-26T12:14:08.968945+0000","last_fullsized":"2024-04-26T12:14:08.968945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.429010+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.429010+0000","last_peered":"2024-04-26T12:13:55.429010+0000","last_clean":"2024-04-26T12:13:55.429010+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.429010+0000","last_undegraded":"2024-04-26T12:13:55.429010+0000","last_fullsized":"2024-04-26T12:13:55.429010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'5","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:05.050139+0000","last_change":"2024-04-26T12:15:05.050238+0000","last_active":"2024-04-26T12:15:05.050139+0000","last_peered":"2024-04-26T12:15:05.050139+0000","last_clean":"2024-04-26T12:15:05.050139+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:15:05.050139+0000","last_undegraded":"2024-04-26T12:15:05.050139+0000","last_fullsized":"2024-04-26T12:15:05.050139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'5","last_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_deep_scrub":"71'5","last_deep_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_clean_scrub_stamp":"2024-04-26T12:15:05.050114+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.650303+0000","scrub_duration":0.0036686359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448329+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448329+0000","last_peered":"2024-04-26T12:13:38.448329+0000","last_clean":"2024-04-26T12:13:38.448329+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448329+0000","last_undegraded":"2024-04-26T12:13:38.448329+0000","last_fullsized":"2024-04-26T12:13:38.448329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":32,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478313+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:27.478313+0000","last_peered":"2024-04-26T12:13:27.478313+0000","last_clean":"2024-04-26T12:13:27.478313+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:27.478313+0000","last_undegraded":"2024-04-26T12:13:27.478313+0000","last_fullsized":"2024-04-26T12:13:27.478313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478094+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:27.478094+0000","last_peered":"2024-04-26T12:13:27.478094+0000","last_clean":"2024-04-26T12:13:27.478094+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:27.478094+0000","last_undegraded":"2024-04-26T12:13:27.478094+0000","last_fullsized":"2024-04-26T12:13:27.478094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'4","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:33.842718+0000","last_change":"2024-04-26T12:14:33.842822+0000","last_active":"2024-04-26T12:14:33.842718+0000","last_peered":"2024-04-26T12:14:33.842718+0000","last_clean":"2024-04-26T12:14:33.842718+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:14:33.842718+0000","last_undegraded":"2024-04-26T12:14:33.842718+0000","last_fullsized":"2024-04-26T12:14:33.842718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_clean_scrub_stamp":"2024-04-26T12:14:33.842693+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:46.697373+0000","scrub_duration":0.0037628990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863656+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863656+0000","last_peered":"2024-04-26T12:13:43.863656+0000","last_clean":"2024-04-26T12:13:43.863656+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863656+0000","last_undegraded":"2024-04-26T12:13:43.863656+0000","last_fullsized":"2024-04-26T12:13:43.863656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.368067+0000","last_change":"2024-04-26T12:14:35.368170+0000","last_active":"2024-04-26T12:14:35.368067+0000","last_peered":"2024-04-26T12:14:35.368067+0000","last_clean":"2024-04-26T12:14:35.368067+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:14:35.368067+0000","last_undegraded":"2024-04-26T12:14:35.368067+0000","last_fullsized":"2024-04-26T12:14:35.368067+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.368043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:47.502525+0000","scrub_duration":0.001810372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916478+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916478+0000","last_peered":"2024-04-26T12:13:45.916478+0000","last_clean":"2024-04-26T12:13:45.916478+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916478+0000","last_undegraded":"2024-04-26T12:13:45.916478+0000","last_fullsized":"2024-04-26T12:13:45.916478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994111+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994111+0000","last_peered":"2024-04-26T12:14:11.994111+0000","last_clean":"2024-04-26T12:14:11.994111+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994111+0000","last_undegraded":"2024-04-26T12:14:11.994111+0000","last_fullsized":"2024-04-26T12:14:11.994111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433336+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433336+0000","last_peered":"2024-04-26T12:13:46.433336+0000","last_clean":"2024-04-26T12:13:46.433336+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433336+0000","last_undegraded":"2024-04-26T12:13:46.433336+0000","last_fullsized":"2024-04-26T12:13:46.433336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'12","reported_seq":46,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.841817+0000","last_change":"2024-04-26T12:14:18.841922+0000","last_active":"2024-04-26T12:14:18.841817+0000","last_peered":"2024-04-26T12:14:18.841817+0000","last_clean":"2024-04-26T12:14:18.841817+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:14:18.841817+0000","last_undegraded":"2024-04-26T12:14:18.841817+0000","last_fullsized":"2024-04-26T12:14:18.841817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.841792+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:13.987239+0000","scrub_duration":0.0044348529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433157+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433157+0000","last_peered":"2024-04-26T12:13:48.433157+0000","last_clean":"2024-04-26T12:13:48.433157+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433157+0000","last_undegraded":"2024-04-26T12:13:48.433157+0000","last_fullsized":"2024-04-26T12:13:48.433157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478494+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:27.478494+0000","last_peered":"2024-04-26T12:13:27.478494+0000","last_clean":"2024-04-26T12:13:27.478494+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:27.478494+0000","last_undegraded":"2024-04-26T12:13:27.478494+0000","last_fullsized":"2024-04-26T12:13:27.478494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403442+0000","last_change":"2024-04-26T12:13:14.393412+0000","last_active":"2024-04-26T12:13:35.403442+0000","last_peered":"2024-04-26T12:13:35.403442+0000","last_clean":"2024-04-26T12:13:35.403442+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:13:35.403442+0000","last_undegraded":"2024-04-26T12:13:35.403442+0000","last_fullsized":"2024-04-26T12:13:35.403442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.959426+0000","last_change":"2024-04-26T12:14:22.959531+0000","last_active":"2024-04-26T12:14:22.959426+0000","last_peered":"2024-04-26T12:14:22.959426+0000","last_clean":"2024-04-26T12:14:22.959426+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:14:22.959426+0000","last_undegraded":"2024-04-26T12:14:22.959426+0000","last_fullsized":"2024-04-26T12:14:22.959426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.959400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.893413+0000","scrub_duration":0.0031299650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:10.948171+0000","last_change":"2024-04-26T12:15:10.948276+0000","last_active":"2024-04-26T12:15:10.948171+0000","last_peered":"2024-04-26T12:15:10.948171+0000","last_clean":"2024-04-26T12:15:10.948171+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:15:10.948171+0000","last_undegraded":"2024-04-26T12:15:10.948171+0000","last_fullsized":"2024-04-26T12:15:10.948171+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_clean_scrub_stamp":"2024-04-26T12:15:10.948146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:24.938423+0000","scrub_duration":0.001742684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'2","reported_seq":39,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.903710+0000","last_change":"2024-04-26T12:14:12.903851+0000","last_active":"2024-04-26T12:14:12.903710+0000","last_peered":"2024-04-26T12:14:12.903710+0000","last_clean":"2024-04-26T12:14:12.903710+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:14:12.903710+0000","last_undegraded":"2024-04-26T12:14:12.903710+0000","last_fullsized":"2024-04-26T12:14:12.903710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.903685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:26.642032+0000","scrub_duration":0.0032440770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879050+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879050+0000","last_peered":"2024-04-26T12:13:47.879050+0000","last_clean":"2024-04-26T12:13:47.879050+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879050+0000","last_undegraded":"2024-04-26T12:13:47.879050+0000","last_fullsized":"2024-04-26T12:13:47.879050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478446+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:27.478446+0000","last_peered":"2024-04-26T12:13:27.478446+0000","last_clean":"2024-04-26T12:13:27.478446+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:27.478446+0000","last_undegraded":"2024-04-26T12:13:27.478446+0000","last_fullsized":"2024-04-26T12:13:27.478446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.481077+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.481077+0000","last_peered":"2024-04-26T12:13:39.481077+0000","last_clean":"2024-04-26T12:13:39.481077+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.481077+0000","last_undegraded":"2024-04-26T12:13:39.481077+0000","last_fullsized":"2024-04-26T12:13:39.481077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.339693+0000","last_change":"2024-04-26T12:14:22.339818+0000","last_active":"2024-04-26T12:14:22.339693+0000","last_peered":"2024-04-26T12:14:22.339693+0000","last_clean":"2024-04-26T12:14:22.339693+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:14:22.339693+0000","last_undegraded":"2024-04-26T12:14:22.339693+0000","last_fullsized":"2024-04-26T12:14:22.339693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.339667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.273680+0000","scrub_duration":0.003330211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.889273+0000","last_change":"2024-04-26T12:14:35.889408+0000","last_active":"2024-04-26T12:14:35.889273+0000","last_peered":"2024-04-26T12:14:35.889273+0000","last_clean":"2024-04-26T12:14:35.889273+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:14:35.889273+0000","last_undegraded":"2024-04-26T12:14:35.889273+0000","last_fullsized":"2024-04-26T12:14:35.889273+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.889249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.444942+0000","scrub_duration":0.0023221090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477520+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:27.477520+0000","last_peered":"2024-04-26T12:13:27.477520+0000","last_clean":"2024-04-26T12:13:27.477520+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:27.477520+0000","last_undegraded":"2024-04-26T12:13:27.477520+0000","last_fullsized":"2024-04-26T12:13:27.477520+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.864959+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.864959+0000","last_peered":"2024-04-26T12:13:37.864959+0000","last_clean":"2024-04-26T12:13:37.864959+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.864959+0000","last_undegraded":"2024-04-26T12:13:37.864959+0000","last_fullsized":"2024-04-26T12:13:37.864959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:01.114069+0000","last_change":"2024-04-26T12:15:01.114240+0000","last_active":"2024-04-26T12:15:01.114069+0000","last_peered":"2024-04-26T12:15:01.114069+0000","last_clean":"2024-04-26T12:15:01.114069+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:15:01.114069+0000","last_undegraded":"2024-04-26T12:15:01.114069+0000","last_fullsized":"2024-04-26T12:15:01.114069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_clean_scrub_stamp":"2024-04-26T12:15:01.114045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:29.694980+0000","scrub_duration":0.0020529889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.824102+0000","last_change":"2024-04-26T12:14:28.824242+0000","last_active":"2024-04-26T12:14:28.824102+0000","last_peered":"2024-04-26T12:14:28.824102+0000","last_clean":"2024-04-26T12:14:28.824102+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:14:28.824102+0000","last_undegraded":"2024-04-26T12:14:28.824102+0000","last_fullsized":"2024-04-26T12:14:28.824102+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.824076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:03.088647+0000","scrub_duration":0.001938574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.943962+0000","last_change":"2024-04-26T12:14:18.944074+0000","last_active":"2024-04-26T12:14:18.943962+0000","last_peered":"2024-04-26T12:14:18.943962+0000","last_clean":"2024-04-26T12:14:18.943962+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:14:18.943962+0000","last_undegraded":"2024-04-26T12:14:18.943962+0000","last_fullsized":"2024-04-26T12:14:18.943962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.943939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:15.950995+0000","scrub_duration":0.001622535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.435152+0000","last_change":"2024-04-26T12:14:57.435295+0000","last_active":"2024-04-26T12:14:57.435152+0000","last_peered":"2024-04-26T12:14:57.435152+0000","last_clean":"2024-04-26T12:14:57.435152+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:14:57.435152+0000","last_undegraded":"2024-04-26T12:14:57.435152+0000","last_fullsized":"2024-04-26T12:14:57.435152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.435128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:29.486293+0000","scrub_duration":0.059299769000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"71'3","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:26.352731+0000","last_change":"2024-04-26T12:14:26.352850+0000","last_active":"2024-04-26T12:14:26.352731+0000","last_peered":"2024-04-26T12:14:26.352731+0000","last_clean":"2024-04-26T12:14:26.352731+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:14:26.352731+0000","last_undegraded":"2024-04-26T12:14:26.352731+0000","last_fullsized":"2024-04-26T12:14:26.352731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_clean_scrub_stamp":"2024-04-26T12:14:26.352705+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:36.999542+0000","scrub_duration":0.0032761019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.970459+0000","last_change":"2024-04-26T12:14:35.970590+0000","last_active":"2024-04-26T12:14:35.970459+0000","last_peered":"2024-04-26T12:14:35.970459+0000","last_clean":"2024-04-26T12:14:35.970459+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:14:35.970459+0000","last_undegraded":"2024-04-26T12:14:35.970459+0000","last_fullsized":"2024-04-26T12:14:35.970459+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.970433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:48.104915+0000","scrub_duration":0.0018752809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344739+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344739+0000","last_peered":"2024-04-26T12:14:08.344739+0000","last_clean":"2024-04-26T12:14:08.344739+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344739+0000","last_undegraded":"2024-04-26T12:14:08.344739+0000","last_fullsized":"2024-04-26T12:14:08.344739+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.943214+0000","last_change":"2024-04-26T12:14:50.943331+0000","last_active":"2024-04-26T12:14:50.943214+0000","last_peered":"2024-04-26T12:14:50.943214+0000","last_clean":"2024-04-26T12:14:50.943214+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:14:50.943214+0000","last_undegraded":"2024-04-26T12:14:50.943214+0000","last_fullsized":"2024-04-26T12:14:50.943214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.943190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.740367+0000","scrub_duration":0.001687745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'2","reported_seq":95,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.465557+0000","last_change":"2024-04-26T12:14:30.465659+0000","last_active":"2024-04-26T12:14:30.465557+0000","last_peered":"2024-04-26T12:14:30.465557+0000","last_clean":"2024-04-26T12:14:30.465557+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:14:30.465557+0000","last_undegraded":"2024-04-26T12:14:30.465557+0000","last_fullsized":"2024-04-26T12:14:30.465557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.465530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:48.739313+0000","scrub_duration":0.0032107360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985324+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985324+0000","last_peered":"2024-04-26T12:14:02.985324+0000","last_clean":"2024-04-26T12:14:02.985324+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985324+0000","last_undegraded":"2024-04-26T12:14:02.985324+0000","last_fullsized":"2024-04-26T12:14:02.985324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:19.306128+0000","last_change":"2024-04-26T12:14:19.306228+0000","last_active":"2024-04-26T12:14:19.306128+0000","last_peered":"2024-04-26T12:14:19.306128+0000","last_clean":"2024-04-26T12:14:19.306128+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:14:19.306128+0000","last_undegraded":"2024-04-26T12:14:19.306128+0000","last_fullsized":"2024-04-26T12:14:19.306128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_clean_scrub_stamp":"2024-04-26T12:14:19.306105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:16.313160+0000","scrub_duration":0.00185067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":235,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764139+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764139+0000","last_peered":"2024-04-26T12:13:57.764139+0000","last_clean":"2024-04-26T12:13:57.764139+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764139+0000","last_undegraded":"2024-04-26T12:13:57.764139+0000","last_fullsized":"2024-04-26T12:13:57.764139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:20.284951+0000","last_change":"2024-04-26T12:14:20.285067+0000","last_active":"2024-04-26T12:14:20.284951+0000","last_peered":"2024-04-26T12:14:20.284951+0000","last_clean":"2024-04-26T12:14:20.284951+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:14:20.284951+0000","last_undegraded":"2024-04-26T12:14:20.284951+0000","last_fullsized":"2024-04-26T12:14:20.284951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_clean_scrub_stamp":"2024-04-26T12:14:20.284929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:17.159266+0000","scrub_duration":0.0019985570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803306+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803306+0000","last_peered":"2024-04-26T12:13:53.803306+0000","last_clean":"2024-04-26T12:13:53.803306+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803306+0000","last_undegraded":"2024-04-26T12:13:53.803306+0000","last_fullsized":"2024-04-26T12:13:53.803306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.079602+0000","last_change":"2024-04-26T12:14:56.079764+0000","last_active":"2024-04-26T12:14:56.079602+0000","last_peered":"2024-04-26T12:14:56.079602+0000","last_clean":"2024-04-26T12:14:56.079602+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:14:56.079602+0000","last_undegraded":"2024-04-26T12:14:56.079602+0000","last_fullsized":"2024-04-26T12:14:56.079602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.079578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:15.852956+0000","scrub_duration":0.0019403910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.463778+0000","last_change":"2024-04-26T12:14:50.463905+0000","last_active":"2024-04-26T12:14:50.463778+0000","last_peered":"2024-04-26T12:14:50.463778+0000","last_clean":"2024-04-26T12:14:50.463778+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:14:50.463778+0000","last_undegraded":"2024-04-26T12:14:50.463778+0000","last_fullsized":"2024-04-26T12:14:50.463778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.463714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.260891+0000","scrub_duration":0.030635608000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833572+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833572+0000","last_peered":"2024-04-26T12:13:42.833572+0000","last_clean":"2024-04-26T12:13:42.833572+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833572+0000","last_undegraded":"2024-04-26T12:13:42.833572+0000","last_fullsized":"2024-04-26T12:13:42.833572+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.332054+0000","last_change":"2024-04-26T12:14:21.332157+0000","last_active":"2024-04-26T12:14:21.332054+0000","last_peered":"2024-04-26T12:14:21.332054+0000","last_clean":"2024-04-26T12:14:21.332054+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:14:21.332054+0000","last_undegraded":"2024-04-26T12:14:21.332054+0000","last_fullsized":"2024-04-26T12:14:21.332054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.332028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.114364+0000","scrub_duration":0.001618303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:52.893612+0000","last_change":"2024-04-26T12:14:52.893734+0000","last_active":"2024-04-26T12:14:52.893612+0000","last_peered":"2024-04-26T12:14:52.893612+0000","last_clean":"2024-04-26T12:14:52.893612+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:14:52.893612+0000","last_undegraded":"2024-04-26T12:14:52.893612+0000","last_fullsized":"2024-04-26T12:14:52.893612+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_clean_scrub_stamp":"2024-04-26T12:14:52.893586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:40.019384+0000","scrub_duration":0.0019374699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.983564+0000","last_change":"2024-04-26T12:14:30.983701+0000","last_active":"2024-04-26T12:14:30.983564+0000","last_peered":"2024-04-26T12:14:30.983564+0000","last_clean":"2024-04-26T12:14:30.983564+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:14:30.983564+0000","last_undegraded":"2024-04-26T12:14:30.983564+0000","last_fullsized":"2024-04-26T12:14:30.983564+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.983541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:49.257324+0000","scrub_duration":0.001498107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.891791+0000","last_change":"2024-04-26T12:14:40.891919+0000","last_active":"2024-04-26T12:14:40.891791+0000","last_peered":"2024-04-26T12:14:40.891791+0000","last_clean":"2024-04-26T12:14:40.891791+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:14:40.891791+0000","last_undegraded":"2024-04-26T12:14:40.891791+0000","last_fullsized":"2024-04-26T12:14:40.891791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_clean_scrub_stamp":"2024-04-26T12:14:40.891766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:11.805668+0000","scrub_duration":0.0015939929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300236+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300236+0000","last_peered":"2024-04-26T12:14:05.300236+0000","last_clean":"2024-04-26T12:14:05.300236+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300236+0000","last_undegraded":"2024-04-26T12:14:05.300236+0000","last_fullsized":"2024-04-26T12:14:05.300236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.033361+0000","last_change":"2024-04-26T12:14:55.033468+0000","last_active":"2024-04-26T12:14:55.033361+0000","last_peered":"2024-04-26T12:14:55.033361+0000","last_clean":"2024-04-26T12:14:55.033361+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:14:55.033361+0000","last_undegraded":"2024-04-26T12:14:55.033361+0000","last_fullsized":"2024-04-26T12:14:55.033361+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.033339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.021427+0000","scrub_duration":0.001908943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.407944+0000","last_change":"2024-04-26T12:14:28.408043+0000","last_active":"2024-04-26T12:14:28.407944+0000","last_peered":"2024-04-26T12:14:28.407944+0000","last_clean":"2024-04-26T12:14:28.407944+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:14:28.407944+0000","last_undegraded":"2024-04-26T12:14:28.407944+0000","last_fullsized":"2024-04-26T12:14:28.407944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.407919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.310058+0000","scrub_duration":0.0017962410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.995143+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:13:53.995143+0000","last_peered":"2024-04-26T12:13:53.995143+0000","last_clean":"2024-04-26T12:13:53.995143+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:53.995143+0000","last_undegraded":"2024-04-26T12:13:53.995143+0000","last_fullsized":"2024-04-26T12:13:53.995143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:41.919441+0000","last_change":"2024-04-26T12:14:41.919576+0000","last_active":"2024-04-26T12:14:41.919441+0000","last_peered":"2024-04-26T12:14:41.919441+0000","last_clean":"2024-04-26T12:14:41.919441+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:14:41.919441+0000","last_undegraded":"2024-04-26T12:14:41.919441+0000","last_fullsized":"2024-04-26T12:14:41.919441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.919408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:23.254496+0000","scrub_duration":0.002109872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.478450+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:27.478450+0000","last_peered":"2024-04-26T12:13:27.478450+0000","last_clean":"2024-04-26T12:13:27.478450+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:27.478450+0000","last_undegraded":"2024-04-26T12:13:27.478450+0000","last_fullsized":"2024-04-26T12:13:27.478450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.045205+0000","last_change":"2024-04-26T12:15:06.045313+0000","last_active":"2024-04-26T12:15:06.045205+0000","last_peered":"2024-04-26T12:15:06.045205+0000","last_clean":"2024-04-26T12:15:06.045205+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:15:06.045205+0000","last_undegraded":"2024-04-26T12:15:06.045205+0000","last_fullsized":"2024-04-26T12:15:06.045205+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.045180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:39.022762+0000","scrub_duration":0.001527748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.987377+0000","last_change":"2024-04-26T12:14:28.987377+0000","last_active":"2024-04-26T12:14:28.987377+0000","last_peered":"2024-04-26T12:14:28.987377+0000","last_clean":"2024-04-26T12:14:28.987377+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:14:28.987377+0000","last_undegraded":"2024-04-26T12:14:28.987377+0000","last_fullsized":"2024-04-26T12:14:28.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.987230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.889368+0000","scrub_duration":0.001924799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:14.918924+0000","last_change":"2024-04-26T12:14:14.918924+0000","last_active":"2024-04-26T12:14:14.918924+0000","last_peered":"2024-04-26T12:14:14.918924+0000","last_clean":"2024-04-26T12:14:14.918924+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:14:14.918924+0000","last_undegraded":"2024-04-26T12:14:14.918924+0000","last_fullsized":"2024-04-26T12:14:14.918924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_clean_scrub_stamp":"2024-04-26T12:14:14.918752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:08.147282+0000","scrub_duration":0.0020495079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'3","reported_seq":39,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.826194+0000","last_change":"2024-04-26T12:14:57.826300+0000","last_active":"2024-04-26T12:14:57.826194+0000","last_peered":"2024-04-26T12:14:57.826194+0000","last_clean":"2024-04-26T12:14:57.826194+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:14:57.826194+0000","last_undegraded":"2024-04-26T12:14:57.826194+0000","last_fullsized":"2024-04-26T12:14:57.826194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.826169+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:06.377686+0000","scrub_duration":0.0034205799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.865694+0000","last_change":"2024-04-26T12:14:55.865871+0000","last_active":"2024-04-26T12:14:55.865694+0000","last_peered":"2024-04-26T12:14:55.865694+0000","last_clean":"2024-04-26T12:14:55.865694+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:14:55.865694+0000","last_undegraded":"2024-04-26T12:14:55.865694+0000","last_fullsized":"2024-04-26T12:14:55.865694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.865666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:46.563067+0000","scrub_duration":0.036040151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'3","reported_seq":48,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.825183+0000","last_change":"2024-04-26T12:14:22.825288+0000","last_active":"2024-04-26T12:14:22.825183+0000","last_peered":"2024-04-26T12:14:22.825183+0000","last_clean":"2024-04-26T12:14:22.825183+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:14:22.825183+0000","last_undegraded":"2024-04-26T12:14:22.825183+0000","last_fullsized":"2024-04-26T12:14:22.825183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.825158+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:07.535329+0000","scrub_duration":0.0029636649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:27.477370+0000","last_change":"2024-04-26T12:13:14.388741+0000","last_active":"2024-04-26T12:13:27.477370+0000","last_peered":"2024-04-26T12:13:27.477370+0000","last_clean":"2024-04-26T12:13:27.477370+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:13:27.477370+0000","last_undegraded":"2024-04-26T12:13:27.477370+0000","last_fullsized":"2024-04-26T12:13:27.477370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.233804+0000","last_change":"2024-04-26T12:14:12.233933+0000","last_active":"2024-04-26T12:14:12.233804+0000","last_peered":"2024-04-26T12:14:12.233804+0000","last_clean":"2024-04-26T12:14:12.233804+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:14:12.233804+0000","last_undegraded":"2024-04-26T12:14:12.233804+0000","last_fullsized":"2024-04-26T12:14:12.233804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.233775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:07.781137+0000","scrub_duration":0.0019158669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:35.403562+0000","last_change":"2024-04-26T12:09:49.379144+0000","last_active":"2024-04-26T12:13:35.403562+0000","last_peered":"2024-04-26T12:13:35.403562+0000","last_clean":"2024-04-26T12:13:35.403562+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:13:35.403562+0000","last_undegraded":"2024-04-26T12:13:35.403562+0000","last_fullsized":"2024-04-26T12:13:35.403562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":99,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403595+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403595+0000","last_peered":"2024-04-26T12:13:51.403595+0000","last_clean":"2024-04-26T12:13:51.403595+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403595+0000","last_undegraded":"2024-04-26T12:13:51.403595+0000","last_fullsized":"2024-04-26T12:13:51.403595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798515+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798515+0000","last_peered":"2024-04-26T12:13:55.798515+0000","last_clean":"2024-04-26T12:13:55.798515+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798515+0000","last_undegraded":"2024-04-26T12:13:55.798515+0000","last_fullsized":"2024-04-26T12:13:55.798515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:59.857539+0000","last_change":"2024-04-26T12:14:59.857635+0000","last_active":"2024-04-26T12:14:59.857539+0000","last_peered":"2024-04-26T12:14:59.857539+0000","last_clean":"2024-04-26T12:14:59.857539+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:14:59.857539+0000","last_undegraded":"2024-04-26T12:14:59.857539+0000","last_fullsized":"2024-04-26T12:14:59.857539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_clean_scrub_stamp":"2024-04-26T12:14:59.857514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.374584+0000","scrub_duration":0.0018552919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406311+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406311+0000","last_peered":"2024-04-26T12:13:47.406311+0000","last_clean":"2024-04-26T12:13:47.406311+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406311+0000","last_undegraded":"2024-04-26T12:13:47.406311+0000","last_fullsized":"2024-04-26T12:13:47.406311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:11.940884+0000","last_change":"2024-04-26T12:15:11.940980+0000","last_active":"2024-04-26T12:15:11.940884+0000","last_peered":"2024-04-26T12:15:11.940884+0000","last_clean":"2024-04-26T12:15:11.940884+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:15:11.940884+0000","last_undegraded":"2024-04-26T12:15:11.940884+0000","last_fullsized":"2024-04-26T12:15:11.940884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_clean_scrub_stamp":"2024-04-26T12:15:11.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:57.982279+0000","scrub_duration":0.001908426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:03.276572+0000","last_change":"2024-04-26T12:15:03.276737+0000","last_active":"2024-04-26T12:15:03.276572+0000","last_peered":"2024-04-26T12:15:03.276572+0000","last_clean":"2024-04-26T12:15:03.276572+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:15:03.276572+0000","last_undegraded":"2024-04-26T12:15:03.276572+0000","last_fullsized":"2024-04-26T12:15:03.276572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_clean_scrub_stamp":"2024-04-26T12:15:03.276548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:41.773127+0000","scrub_duration":0.030246775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Apr 26 12:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.378,"5min":0.16,"15min":0.16},"max":{"1min":0.66400000000000003,"5min":1.504,"15min":1.504},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.64300000000000002,"5min":2.383,"15min":2.383},"last":0.60199999999999998}]}]},{"osd":0,"up_from":64,"seq":274877906970,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.38800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738437,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Apr 26 12:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48199999999999998,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.65500000000000003,"5min":2.214,"15min":2.214},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53000000000000003,"15min":0.44},"min":{"1min":0.40300000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.61099999999999999,"5min":2.294,"15min":2.294},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:15:18.428 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.428 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.428 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.429 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.430 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.430 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.430 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.430 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.430 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.431 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.431 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.431 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.431 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.432 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:18.432 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:15:38.432 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:15:38.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:15:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:15:38.826 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-26T12:15:36.953932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895460+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895460+0000","last_peered":"2024-04-26T12:13:40.895460+0000","last_clean":"2024-04-26T12:13:40.895460+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895460+0000","last_undegraded":"2024-04-26T12:13:40.895460+0000","last_fullsized":"2024-04-26T12:13:40.895460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:22.989975+0000","last_change":"2024-04-26T12:15:22.990086+0000","last_active":"2024-04-26T12:15:22.989975+0000","last_peered":"2024-04-26T12:15:22.989975+0000","last_clean":"2024-04-26T12:15:22.989975+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:15:22.989975+0000","last_undegraded":"2024-04-26T12:15:22.989975+0000","last_fullsized":"2024-04-26T12:15:22.989975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:22.989949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:22.989949+0000","last_clean_scrub_stamp":"2024-04-26T12:15:22.989949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:23.505337+0000","scrub_duration":0.00186264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900430+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900430+0000","last_peered":"2024-04-26T12:13:39.900430+0000","last_clean":"2024-04-26T12:13:39.900430+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900430+0000","last_undegraded":"2024-04-26T12:13:39.900430+0000","last_fullsized":"2024-04-26T12:13:39.900430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:30.560988+0000","last_change":"2024-04-26T12:15:30.561091+0000","last_active":"2024-04-26T12:15:30.560988+0000","last_peered":"2024-04-26T12:15:30.560988+0000","last_clean":"2024-04-26T12:15:30.560988+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:15:30.560988+0000","last_undegraded":"2024-04-26T12:15:30.560988+0000","last_fullsized":"2024-04-26T12:15:30.560988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:30.560966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:30.560966+0000","last_clean_scrub_stamp":"2024-04-26T12:15:30.560966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:24.644207+0000","scrub_duration":0.001942626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.957122+0000","last_change":"2024-04-26T12:14:21.957122+0000","last_active":"2024-04-26T12:14:21.957122+0000","last_peered":"2024-04-26T12:14:21.957122+0000","last_clean":"2024-04-26T12:14:21.957122+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:14:21.957122+0000","last_undegraded":"2024-04-26T12:14:21.957122+0000","last_fullsized":"2024-04-26T12:14:21.957122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.956989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.739324+0000","scrub_duration":0.017760125000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.857322+0000","last_change":"2024-04-26T12:14:30.857441+0000","last_active":"2024-04-26T12:14:30.857322+0000","last_peered":"2024-04-26T12:14:30.857322+0000","last_clean":"2024-04-26T12:14:30.857322+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:14:30.857322+0000","last_undegraded":"2024-04-26T12:14:30.857322+0000","last_fullsized":"2024-04-26T12:14:30.857322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.857300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:25.197434+0000","scrub_duration":0.0017286269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:14.796338+0000","last_change":"2024-04-26T12:15:14.796458+0000","last_active":"2024-04-26T12:15:14.796338+0000","last_peered":"2024-04-26T12:15:14.796338+0000","last_clean":"2024-04-26T12:15:14.796338+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:15:14.796338+0000","last_undegraded":"2024-04-26T12:15:14.796338+0000","last_fullsized":"2024-04-26T12:15:14.796338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:14.796316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:14.796316+0000","last_clean_scrub_stamp":"2024-04-26T12:15:14.796316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:39.641302+0000","scrub_duration":0.018361062000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:13.783940+0000","last_change":"2024-04-26T12:15:13.784060+0000","last_active":"2024-04-26T12:15:13.783940+0000","last_peered":"2024-04-26T12:15:13.783940+0000","last_clean":"2024-04-26T12:15:13.783940+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:15:13.783940+0000","last_undegraded":"2024-04-26T12:15:13.783940+0000","last_fullsized":"2024-04-26T12:15:13.783940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:13.783914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:13.783914+0000","last_clean_scrub_stamp":"2024-04-26T12:15:13.783914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:51.230549+0000","scrub_duration":0.00186824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.234851+0000","last_change":"2024-04-26T12:15:06.234993+0000","last_active":"2024-04-26T12:15:06.234851+0000","last_peered":"2024-04-26T12:15:06.234851+0000","last_clean":"2024-04-26T12:15:06.234851+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:15:06.234851+0000","last_undegraded":"2024-04-26T12:15:06.234851+0000","last_fullsized":"2024-04-26T12:15:06.234851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.234824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:39.262367+0000","scrub_duration":0.03054697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:27.017214+0000","last_change":"2024-04-26T12:14:27.017214+0000","last_active":"2024-04-26T12:14:27.017214+0000","last_peered":"2024-04-26T12:14:27.017214+0000","last_clean":"2024-04-26T12:14:27.017214+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:14:27.017214+0000","last_undegraded":"2024-04-26T12:14:27.017214+0000","last_fullsized":"2024-04-26T12:14:27.017214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_clean_scrub_stamp":"2024-04-26T12:14:27.017091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:37.663928+0000","scrub_duration":0.001639759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:29.611304+0000","last_change":"2024-04-26T12:15:29.611444+0000","last_active":"2024-04-26T12:15:29.611304+0000","last_peered":"2024-04-26T12:15:29.611304+0000","last_clean":"2024-04-26T12:15:29.611304+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:15:29.611304+0000","last_undegraded":"2024-04-26T12:15:29.611304+0000","last_fullsized":"2024-04-26T12:15:29.611304+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:29.611262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:29.611262+0000","last_clean_scrub_stamp":"2024-04-26T12:15:29.611262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:58.849517+0000","scrub_duration":0.017749485999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:17.937988+0000","last_change":"2024-04-26T12:15:17.938118+0000","last_active":"2024-04-26T12:15:17.937988+0000","last_peered":"2024-04-26T12:15:17.937988+0000","last_clean":"2024-04-26T12:15:17.937988+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:15:17.937988+0000","last_undegraded":"2024-04-26T12:15:17.937988+0000","last_fullsized":"2024-04-26T12:15:17.937988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:17.937964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:17.937964+0000","last_clean_scrub_stamp":"2024-04-26T12:15:17.937964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.759628+0000","scrub_duration":0.0019884460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768255+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768255+0000","last_peered":"2024-04-26T12:13:37.768255+0000","last_clean":"2024-04-26T12:13:37.768255+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768255+0000","last_undegraded":"2024-04-26T12:13:37.768255+0000","last_fullsized":"2024-04-26T12:13:37.768255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845784+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:34.845784+0000","last_peered":"2024-04-26T12:13:34.845784+0000","last_clean":"2024-04-26T12:13:34.845784+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:34.845784+0000","last_undegraded":"2024-04-26T12:13:34.845784+0000","last_fullsized":"2024-04-26T12:13:34.845784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845686+0000","last_change":"2024-04-26T12:13:14.391004+0000","last_active":"2024-04-26T12:13:34.845686+0000","last_peered":"2024-04-26T12:13:34.845686+0000","last_clean":"2024-04-26T12:13:34.845686+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:13:34.845686+0000","last_undegraded":"2024-04-26T12:13:34.845686+0000","last_fullsized":"2024-04-26T12:13:34.845686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:16.737298+0000","last_change":"2024-04-26T12:15:16.737298+0000","last_active":"2024-04-26T12:15:16.737298+0000","last_peered":"2024-04-26T12:15:16.737298+0000","last_clean":"2024-04-26T12:15:16.737298+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:15:16.737298+0000","last_undegraded":"2024-04-26T12:15:16.737298+0000","last_fullsized":"2024-04-26T12:15:16.737298+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:16.737138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:16.737138+0000","last_clean_scrub_stamp":"2024-04-26T12:15:16.737138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:23.146620+0000","scrub_duration":0.001865359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:04.332453+0000","last_change":"2024-04-26T12:15:04.332686+0000","last_active":"2024-04-26T12:15:04.332453+0000","last_peered":"2024-04-26T12:15:04.332453+0000","last_clean":"2024-04-26T12:15:04.332453+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:15:04.332453+0000","last_undegraded":"2024-04-26T12:15:04.332453+0000","last_fullsized":"2024-04-26T12:15:04.332453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_clean_scrub_stamp":"2024-04-26T12:15:04.332430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:30.932618+0000","scrub_duration":0.085013177999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:07.011617+0000","last_change":"2024-04-26T12:15:07.011766+0000","last_active":"2024-04-26T12:15:07.011617+0000","last_peered":"2024-04-26T12:15:07.011617+0000","last_clean":"2024-04-26T12:15:07.011617+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:15:07.011617+0000","last_undegraded":"2024-04-26T12:15:07.011617+0000","last_fullsized":"2024-04-26T12:15:07.011617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_clean_scrub_stamp":"2024-04-26T12:15:07.011593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:28.154774+0000","scrub_duration":0.0018777920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:13.303269+0000","last_change":"2024-04-26T12:14:13.303269+0000","last_active":"2024-04-26T12:14:13.303269+0000","last_peered":"2024-04-26T12:14:13.303269+0000","last_clean":"2024-04-26T12:14:13.303269+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:14:13.303269+0000","last_undegraded":"2024-04-26T12:14:13.303269+0000","last_fullsized":"2024-04-26T12:14:13.303269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_clean_scrub_stamp":"2024-04-26T12:14:13.303081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.143477+0000","scrub_duration":0.030270521000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.939043+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.939043+0000","last_peered":"2024-04-26T12:14:06.939043+0000","last_clean":"2024-04-26T12:14:06.939043+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.939043+0000","last_undegraded":"2024-04-26T12:14:06.939043+0000","last_fullsized":"2024-04-26T12:14:06.939043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:24.762804+0000","last_change":"2024-04-26T12:15:24.762804+0000","last_active":"2024-04-26T12:15:24.762804+0000","last_peered":"2024-04-26T12:15:24.762804+0000","last_clean":"2024-04-26T12:15:24.762804+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:15:24.762804+0000","last_undegraded":"2024-04-26T12:15:24.762804+0000","last_fullsized":"2024-04-26T12:15:24.762804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:24.762636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:24.762636+0000","last_clean_scrub_stamp":"2024-04-26T12:15:24.762636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:38.325160+0000","scrub_duration":0.026021782,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945792+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945792+0000","last_peered":"2024-04-26T12:13:55.945792+0000","last_clean":"2024-04-26T12:13:55.945792+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945792+0000","last_undegraded":"2024-04-26T12:13:55.945792+0000","last_fullsized":"2024-04-26T12:13:55.945792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.353952+0000","last_change":"2024-04-26T12:14:56.354059+0000","last_active":"2024-04-26T12:14:56.353952+0000","last_peered":"2024-04-26T12:14:56.353952+0000","last_clean":"2024-04-26T12:14:56.353952+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:14:56.353952+0000","last_undegraded":"2024-04-26T12:14:56.353952+0000","last_fullsized":"2024-04-26T12:14:56.353952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.353928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:28.867805+0000","scrub_duration":0.0017401999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:02.259695+0000","last_change":"2024-04-26T12:15:02.259805+0000","last_active":"2024-04-26T12:15:02.259695+0000","last_peered":"2024-04-26T12:15:02.259695+0000","last_clean":"2024-04-26T12:15:02.259695+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:15:02.259695+0000","last_undegraded":"2024-04-26T12:15:02.259695+0000","last_fullsized":"2024-04-26T12:15:02.259695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_clean_scrub_stamp":"2024-04-26T12:15:02.259669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:17.697891+0000","scrub_duration":0.0016369970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845626+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:34.845626+0000","last_peered":"2024-04-26T12:13:34.845626+0000","last_clean":"2024-04-26T12:13:34.845626+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:34.845626+0000","last_undegraded":"2024-04-26T12:13:34.845626+0000","last_fullsized":"2024-04-26T12:13:34.845626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.065209+0000","last_change":"2024-04-26T12:14:57.065316+0000","last_active":"2024-04-26T12:14:57.065209+0000","last_peered":"2024-04-26T12:14:57.065209+0000","last_clean":"2024-04-26T12:14:57.065209+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:14:57.065209+0000","last_undegraded":"2024-04-26T12:14:57.065209+0000","last_fullsized":"2024-04-26T12:14:57.065209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.065182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:12.857856+0000","scrub_duration":0.001780539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963249+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963249+0000","last_peered":"2024-04-26T12:13:54.963249+0000","last_clean":"2024-04-26T12:13:54.963249+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963249+0000","last_undegraded":"2024-04-26T12:13:54.963249+0000","last_fullsized":"2024-04-26T12:13:54.963249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384596+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384596+0000","last_peered":"2024-04-26T12:13:56.384596+0000","last_clean":"2024-04-26T12:13:56.384596+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384596+0000","last_undegraded":"2024-04-26T12:13:56.384596+0000","last_fullsized":"2024-04-26T12:13:56.384596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.342527+0000","last_change":"2024-04-26T12:14:55.342633+0000","last_active":"2024-04-26T12:14:55.342527+0000","last_peered":"2024-04-26T12:14:55.342527+0000","last_clean":"2024-04-26T12:14:55.342527+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:14:55.342527+0000","last_undegraded":"2024-04-26T12:14:55.342527+0000","last_fullsized":"2024-04-26T12:14:55.342527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.342504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.330593+0000","scrub_duration":0.001697816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345322+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345322+0000","last_peered":"2024-04-26T12:14:06.345322+0000","last_clean":"2024-04-26T12:14:06.345322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345322+0000","last_undegraded":"2024-04-26T12:14:06.345322+0000","last_fullsized":"2024-04-26T12:14:06.345322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.973075+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.973075+0000","last_peered":"2024-04-26T12:13:46.973075+0000","last_clean":"2024-04-26T12:13:46.973075+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.973075+0000","last_undegraded":"2024-04-26T12:13:46.973075+0000","last_fullsized":"2024-04-26T12:13:46.973075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:15.275693+0000","last_change":"2024-04-26T12:14:15.275693+0000","last_active":"2024-04-26T12:14:15.275693+0000","last_peered":"2024-04-26T12:14:15.275693+0000","last_clean":"2024-04-26T12:14:15.275693+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:14:15.275693+0000","last_undegraded":"2024-04-26T12:14:15.275693+0000","last_fullsized":"2024-04-26T12:14:15.275693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_clean_scrub_stamp":"2024-04-26T12:14:15.275528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:03.816301+0000","scrub_duration":0.0017978549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448534+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448534+0000","last_peered":"2024-04-26T12:13:40.448534+0000","last_clean":"2024-04-26T12:13:40.448534+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448534+0000","last_undegraded":"2024-04-26T12:13:40.448534+0000","last_fullsized":"2024-04-26T12:13:40.448534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.968945+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.968945+0000","last_peered":"2024-04-26T12:14:08.968945+0000","last_clean":"2024-04-26T12:14:08.968945+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.968945+0000","last_undegraded":"2024-04-26T12:14:08.968945+0000","last_fullsized":"2024-04-26T12:14:08.968945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.429010+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.429010+0000","last_peered":"2024-04-26T12:13:55.429010+0000","last_clean":"2024-04-26T12:13:55.429010+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.429010+0000","last_undegraded":"2024-04-26T12:13:55.429010+0000","last_fullsized":"2024-04-26T12:13:55.429010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'5","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:05.050139+0000","last_change":"2024-04-26T12:15:05.050238+0000","last_active":"2024-04-26T12:15:05.050139+0000","last_peered":"2024-04-26T12:15:05.050139+0000","last_clean":"2024-04-26T12:15:05.050139+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:15:05.050139+0000","last_undegraded":"2024-04-26T12:15:05.050139+0000","last_fullsized":"2024-04-26T12:15:05.050139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'5","last_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_deep_scrub":"71'5","last_deep_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_clean_scrub_stamp":"2024-04-26T12:15:05.050114+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.650303+0000","scrub_duration":0.0036686359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448329+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448329+0000","last_peered":"2024-04-26T12:13:38.448329+0000","last_clean":"2024-04-26T12:13:38.448329+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448329+0000","last_undegraded":"2024-04-26T12:13:38.448329+0000","last_fullsized":"2024-04-26T12:13:38.448329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":33,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845360+0000","last_change":"2024-04-26T12:13:14.391869+0000","last_active":"2024-04-26T12:13:34.845360+0000","last_peered":"2024-04-26T12:13:34.845360+0000","last_clean":"2024-04-26T12:13:34.845360+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:13:34.845360+0000","last_undegraded":"2024-04-26T12:13:34.845360+0000","last_fullsized":"2024-04-26T12:13:34.845360+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845521+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:34.845521+0000","last_peered":"2024-04-26T12:13:34.845521+0000","last_clean":"2024-04-26T12:13:34.845521+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:34.845521+0000","last_undegraded":"2024-04-26T12:13:34.845521+0000","last_fullsized":"2024-04-26T12:13:34.845521+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'4","reported_seq":41,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:33.842822+0000","last_change":"2024-04-26T12:14:33.842822+0000","last_active":"2024-04-26T12:14:33.842822+0000","last_peered":"2024-04-26T12:14:33.842822+0000","last_clean":"2024-04-26T12:14:33.842822+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:14:33.842822+0000","last_undegraded":"2024-04-26T12:14:33.842822+0000","last_fullsized":"2024-04-26T12:14:33.842822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_clean_scrub_stamp":"2024-04-26T12:14:33.842693+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:46.697373+0000","scrub_duration":0.0037628990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863656+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863656+0000","last_peered":"2024-04-26T12:13:43.863656+0000","last_clean":"2024-04-26T12:13:43.863656+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863656+0000","last_undegraded":"2024-04-26T12:13:43.863656+0000","last_fullsized":"2024-04-26T12:13:43.863656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.368067+0000","last_change":"2024-04-26T12:14:35.368170+0000","last_active":"2024-04-26T12:14:35.368067+0000","last_peered":"2024-04-26T12:14:35.368067+0000","last_clean":"2024-04-26T12:14:35.368067+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:14:35.368067+0000","last_undegraded":"2024-04-26T12:14:35.368067+0000","last_fullsized":"2024-04-26T12:14:35.368067+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.368043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:47.502525+0000","scrub_duration":0.001810372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916478+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916478+0000","last_peered":"2024-04-26T12:13:45.916478+0000","last_clean":"2024-04-26T12:13:45.916478+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916478+0000","last_undegraded":"2024-04-26T12:13:45.916478+0000","last_fullsized":"2024-04-26T12:13:45.916478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994111+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994111+0000","last_peered":"2024-04-26T12:14:11.994111+0000","last_clean":"2024-04-26T12:14:11.994111+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994111+0000","last_undegraded":"2024-04-26T12:14:11.994111+0000","last_fullsized":"2024-04-26T12:14:11.994111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433336+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433336+0000","last_peered":"2024-04-26T12:13:46.433336+0000","last_clean":"2024-04-26T12:13:46.433336+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433336+0000","last_undegraded":"2024-04-26T12:13:46.433336+0000","last_fullsized":"2024-04-26T12:13:46.433336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'12","reported_seq":47,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.841922+0000","last_change":"2024-04-26T12:14:18.841922+0000","last_active":"2024-04-26T12:14:18.841922+0000","last_peered":"2024-04-26T12:14:18.841922+0000","last_clean":"2024-04-26T12:14:18.841922+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:14:18.841922+0000","last_undegraded":"2024-04-26T12:14:18.841922+0000","last_fullsized":"2024-04-26T12:14:18.841922+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.841792+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:13.987239+0000","scrub_duration":0.0044348529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433157+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433157+0000","last_peered":"2024-04-26T12:13:48.433157+0000","last_clean":"2024-04-26T12:13:48.433157+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433157+0000","last_undegraded":"2024-04-26T12:13:48.433157+0000","last_fullsized":"2024-04-26T12:13:48.433157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845305+0000","last_change":"2024-04-26T12:13:14.392077+0000","last_active":"2024-04-26T12:13:34.845305+0000","last_peered":"2024-04-26T12:13:34.845305+0000","last_clean":"2024-04-26T12:13:34.845305+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:13:34.845305+0000","last_undegraded":"2024-04-26T12:13:34.845305+0000","last_fullsized":"2024-04-26T12:13:34.845305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:13.928108+0000","last_change":"2024-04-26T12:15:13.928200+0000","last_active":"2024-04-26T12:15:13.928108+0000","last_peered":"2024-04-26T12:15:13.928108+0000","last_clean":"2024-04-26T12:15:13.928108+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:15:13.928108+0000","last_undegraded":"2024-04-26T12:15:13.928108+0000","last_fullsized":"2024-04-26T12:15:13.928108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:13.928083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:13.928083+0000","last_clean_scrub_stamp":"2024-04-26T12:15:13.928083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:45.700894+0000","scrub_duration":0.0017930660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.959426+0000","last_change":"2024-04-26T12:14:22.959531+0000","last_active":"2024-04-26T12:14:22.959426+0000","last_peered":"2024-04-26T12:14:22.959426+0000","last_clean":"2024-04-26T12:14:22.959426+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:14:22.959426+0000","last_undegraded":"2024-04-26T12:14:22.959426+0000","last_fullsized":"2024-04-26T12:14:22.959426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.959400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.893413+0000","scrub_duration":0.0031299650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:10.948171+0000","last_change":"2024-04-26T12:15:10.948276+0000","last_active":"2024-04-26T12:15:10.948171+0000","last_peered":"2024-04-26T12:15:10.948171+0000","last_clean":"2024-04-26T12:15:10.948171+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:15:10.948171+0000","last_undegraded":"2024-04-26T12:15:10.948171+0000","last_fullsized":"2024-04-26T12:15:10.948171+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_clean_scrub_stamp":"2024-04-26T12:15:10.948146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:24.938423+0000","scrub_duration":0.001742684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'2","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.903851+0000","last_change":"2024-04-26T12:14:12.903851+0000","last_active":"2024-04-26T12:14:12.903851+0000","last_peered":"2024-04-26T12:14:12.903851+0000","last_clean":"2024-04-26T12:14:12.903851+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:14:12.903851+0000","last_undegraded":"2024-04-26T12:14:12.903851+0000","last_fullsized":"2024-04-26T12:14:12.903851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.903685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:26.642032+0000","scrub_duration":0.0032440770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879159+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879159+0000","last_peered":"2024-04-26T12:13:47.879159+0000","last_clean":"2024-04-26T12:13:47.879159+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879159+0000","last_undegraded":"2024-04-26T12:13:47.879159+0000","last_fullsized":"2024-04-26T12:13:47.879159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845270+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:34.845270+0000","last_peered":"2024-04-26T12:13:34.845270+0000","last_clean":"2024-04-26T12:13:34.845270+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:34.845270+0000","last_undegraded":"2024-04-26T12:13:34.845270+0000","last_fullsized":"2024-04-26T12:13:34.845270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.481077+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.481077+0000","last_peered":"2024-04-26T12:13:39.481077+0000","last_clean":"2024-04-26T12:13:39.481077+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.481077+0000","last_undegraded":"2024-04-26T12:13:39.481077+0000","last_fullsized":"2024-04-26T12:13:39.481077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.339693+0000","last_change":"2024-04-26T12:14:22.339818+0000","last_active":"2024-04-26T12:14:22.339693+0000","last_peered":"2024-04-26T12:14:22.339693+0000","last_clean":"2024-04-26T12:14:22.339693+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:14:22.339693+0000","last_undegraded":"2024-04-26T12:14:22.339693+0000","last_fullsized":"2024-04-26T12:14:22.339693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.339667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.273680+0000","scrub_duration":0.003330211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.889408+0000","last_change":"2024-04-26T12:14:35.889408+0000","last_active":"2024-04-26T12:14:35.889408+0000","last_peered":"2024-04-26T12:14:35.889408+0000","last_clean":"2024-04-26T12:14:35.889408+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:14:35.889408+0000","last_undegraded":"2024-04-26T12:14:35.889408+0000","last_fullsized":"2024-04-26T12:14:35.889408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.889249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.444942+0000","scrub_duration":0.0023221090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845286+0000","last_change":"2024-04-26T12:13:14.390929+0000","last_active":"2024-04-26T12:13:34.845286+0000","last_peered":"2024-04-26T12:13:34.845286+0000","last_clean":"2024-04-26T12:13:34.845286+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:13:34.845286+0000","last_undegraded":"2024-04-26T12:13:34.845286+0000","last_fullsized":"2024-04-26T12:13:34.845286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.865071+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.865071+0000","last_peered":"2024-04-26T12:13:37.865071+0000","last_clean":"2024-04-26T12:13:37.865071+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.865071+0000","last_undegraded":"2024-04-26T12:13:37.865071+0000","last_fullsized":"2024-04-26T12:13:37.865071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:01.114069+0000","last_change":"2024-04-26T12:15:01.114240+0000","last_active":"2024-04-26T12:15:01.114069+0000","last_peered":"2024-04-26T12:15:01.114069+0000","last_clean":"2024-04-26T12:15:01.114069+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:15:01.114069+0000","last_undegraded":"2024-04-26T12:15:01.114069+0000","last_fullsized":"2024-04-26T12:15:01.114069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_clean_scrub_stamp":"2024-04-26T12:15:01.114045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:29.694980+0000","scrub_duration":0.0020529889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.824242+0000","last_change":"2024-04-26T12:14:28.824242+0000","last_active":"2024-04-26T12:14:28.824242+0000","last_peered":"2024-04-26T12:14:28.824242+0000","last_clean":"2024-04-26T12:14:28.824242+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:14:28.824242+0000","last_undegraded":"2024-04-26T12:14:28.824242+0000","last_fullsized":"2024-04-26T12:14:28.824242+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.824076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:03.088647+0000","scrub_duration":0.001938574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.943962+0000","last_change":"2024-04-26T12:14:18.944074+0000","last_active":"2024-04-26T12:14:18.943962+0000","last_peered":"2024-04-26T12:14:18.943962+0000","last_clean":"2024-04-26T12:14:18.943962+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:14:18.943962+0000","last_undegraded":"2024-04-26T12:14:18.943962+0000","last_fullsized":"2024-04-26T12:14:18.943962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.943939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:15.950995+0000","scrub_duration":0.001622535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.435152+0000","last_change":"2024-04-26T12:14:57.435295+0000","last_active":"2024-04-26T12:14:57.435152+0000","last_peered":"2024-04-26T12:14:57.435152+0000","last_clean":"2024-04-26T12:14:57.435152+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:14:57.435152+0000","last_undegraded":"2024-04-26T12:14:57.435152+0000","last_fullsized":"2024-04-26T12:14:57.435152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.435128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:29.486293+0000","scrub_duration":0.059299769000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"71'3","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:26.352731+0000","last_change":"2024-04-26T12:14:26.352850+0000","last_active":"2024-04-26T12:14:26.352731+0000","last_peered":"2024-04-26T12:14:26.352731+0000","last_clean":"2024-04-26T12:14:26.352731+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:14:26.352731+0000","last_undegraded":"2024-04-26T12:14:26.352731+0000","last_fullsized":"2024-04-26T12:14:26.352731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_clean_scrub_stamp":"2024-04-26T12:14:26.352705+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:36.999542+0000","scrub_duration":0.0032761019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.970459+0000","last_change":"2024-04-26T12:14:35.970590+0000","last_active":"2024-04-26T12:14:35.970459+0000","last_peered":"2024-04-26T12:14:35.970459+0000","last_clean":"2024-04-26T12:14:35.970459+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:14:35.970459+0000","last_undegraded":"2024-04-26T12:14:35.970459+0000","last_fullsized":"2024-04-26T12:14:35.970459+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.970433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:48.104915+0000","scrub_duration":0.0018752809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344739+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344739+0000","last_peered":"2024-04-26T12:14:08.344739+0000","last_clean":"2024-04-26T12:14:08.344739+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344739+0000","last_undegraded":"2024-04-26T12:14:08.344739+0000","last_fullsized":"2024-04-26T12:14:08.344739+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.943214+0000","last_change":"2024-04-26T12:14:50.943331+0000","last_active":"2024-04-26T12:14:50.943214+0000","last_peered":"2024-04-26T12:14:50.943214+0000","last_clean":"2024-04-26T12:14:50.943214+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:14:50.943214+0000","last_undegraded":"2024-04-26T12:14:50.943214+0000","last_fullsized":"2024-04-26T12:14:50.943214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.943190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.740367+0000","scrub_duration":0.001687745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'2","reported_seq":95,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.465557+0000","last_change":"2024-04-26T12:14:30.465659+0000","last_active":"2024-04-26T12:14:30.465557+0000","last_peered":"2024-04-26T12:14:30.465557+0000","last_clean":"2024-04-26T12:14:30.465557+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:14:30.465557+0000","last_undegraded":"2024-04-26T12:14:30.465557+0000","last_fullsized":"2024-04-26T12:14:30.465557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.465530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:48.739313+0000","scrub_duration":0.0032107360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985324+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985324+0000","last_peered":"2024-04-26T12:14:02.985324+0000","last_clean":"2024-04-26T12:14:02.985324+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985324+0000","last_undegraded":"2024-04-26T12:14:02.985324+0000","last_fullsized":"2024-04-26T12:14:02.985324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:19.306128+0000","last_change":"2024-04-26T12:14:19.306228+0000","last_active":"2024-04-26T12:14:19.306128+0000","last_peered":"2024-04-26T12:14:19.306128+0000","last_clean":"2024-04-26T12:14:19.306128+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:14:19.306128+0000","last_undegraded":"2024-04-26T12:14:19.306128+0000","last_fullsized":"2024-04-26T12:14:19.306128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_clean_scrub_stamp":"2024-04-26T12:14:19.306105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:16.313160+0000","scrub_duration":0.00185067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":235,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764139+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764139+0000","last_peered":"2024-04-26T12:13:57.764139+0000","last_clean":"2024-04-26T12:13:57.764139+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764139+0000","last_undegraded":"2024-04-26T12:13:57.764139+0000","last_fullsized":"2024-04-26T12:13:57.764139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:20.284951+0000","last_change":"2024-04-26T12:14:20.285067+0000","last_active":"2024-04-26T12:14:20.284951+0000","last_peered":"2024-04-26T12:14:20.284951+0000","last_clean":"2024-04-26T12:14:20.284951+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:14:20.284951+0000","last_undegraded":"2024-04-26T12:14:20.284951+0000","last_fullsized":"2024-04-26T12:14:20.284951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_clean_scrub_stamp":"2024-04-26T12:14:20.284929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:17.159266+0000","scrub_duration":0.0019985570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803474+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803474+0000","last_peered":"2024-04-26T12:13:53.803474+0000","last_clean":"2024-04-26T12:13:53.803474+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803474+0000","last_undegraded":"2024-04-26T12:13:53.803474+0000","last_fullsized":"2024-04-26T12:13:53.803474+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.079602+0000","last_change":"2024-04-26T12:14:56.079764+0000","last_active":"2024-04-26T12:14:56.079602+0000","last_peered":"2024-04-26T12:14:56.079602+0000","last_clean":"2024-04-26T12:14:56.079602+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:14:56.079602+0000","last_undegraded":"2024-04-26T12:14:56.079602+0000","last_fullsized":"2024-04-26T12:14:56.079602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.079578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:15.852956+0000","scrub_duration":0.0019403910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.463778+0000","last_change":"2024-04-26T12:14:50.463905+0000","last_active":"2024-04-26T12:14:50.463778+0000","last_peered":"2024-04-26T12:14:50.463778+0000","last_clean":"2024-04-26T12:14:50.463778+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:14:50.463778+0000","last_undegraded":"2024-04-26T12:14:50.463778+0000","last_fullsized":"2024-04-26T12:14:50.463778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.463714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.260891+0000","scrub_duration":0.030635608000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833572+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833572+0000","last_peered":"2024-04-26T12:13:42.833572+0000","last_clean":"2024-04-26T12:13:42.833572+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833572+0000","last_undegraded":"2024-04-26T12:13:42.833572+0000","last_fullsized":"2024-04-26T12:13:42.833572+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.332054+0000","last_change":"2024-04-26T12:14:21.332157+0000","last_active":"2024-04-26T12:14:21.332054+0000","last_peered":"2024-04-26T12:14:21.332054+0000","last_clean":"2024-04-26T12:14:21.332054+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:14:21.332054+0000","last_undegraded":"2024-04-26T12:14:21.332054+0000","last_fullsized":"2024-04-26T12:14:21.332054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.332028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.114364+0000","scrub_duration":0.001618303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:52.893734+0000","last_change":"2024-04-26T12:14:52.893734+0000","last_active":"2024-04-26T12:14:52.893734+0000","last_peered":"2024-04-26T12:14:52.893734+0000","last_clean":"2024-04-26T12:14:52.893734+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:14:52.893734+0000","last_undegraded":"2024-04-26T12:14:52.893734+0000","last_fullsized":"2024-04-26T12:14:52.893734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_clean_scrub_stamp":"2024-04-26T12:14:52.893586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:40.019384+0000","scrub_duration":0.0019374699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.983564+0000","last_change":"2024-04-26T12:14:30.983701+0000","last_active":"2024-04-26T12:14:30.983564+0000","last_peered":"2024-04-26T12:14:30.983564+0000","last_clean":"2024-04-26T12:14:30.983564+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:14:30.983564+0000","last_undegraded":"2024-04-26T12:14:30.983564+0000","last_fullsized":"2024-04-26T12:14:30.983564+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.983541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:49.257324+0000","scrub_duration":0.001498107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.891919+0000","last_change":"2024-04-26T12:14:40.891919+0000","last_active":"2024-04-26T12:14:40.891919+0000","last_peered":"2024-04-26T12:14:40.891919+0000","last_clean":"2024-04-26T12:14:40.891919+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:14:40.891919+0000","last_undegraded":"2024-04-26T12:14:40.891919+0000","last_fullsized":"2024-04-26T12:14:40.891919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_clean_scrub_stamp":"2024-04-26T12:14:40.891766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:11.805668+0000","scrub_duration":0.0015939929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300236+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300236+0000","last_peered":"2024-04-26T12:14:05.300236+0000","last_clean":"2024-04-26T12:14:05.300236+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300236+0000","last_undegraded":"2024-04-26T12:14:05.300236+0000","last_fullsized":"2024-04-26T12:14:05.300236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.033361+0000","last_change":"2024-04-26T12:14:55.033468+0000","last_active":"2024-04-26T12:14:55.033361+0000","last_peered":"2024-04-26T12:14:55.033361+0000","last_clean":"2024-04-26T12:14:55.033361+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:14:55.033361+0000","last_undegraded":"2024-04-26T12:14:55.033361+0000","last_fullsized":"2024-04-26T12:14:55.033361+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.033339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.021427+0000","scrub_duration":0.001908943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.407944+0000","last_change":"2024-04-26T12:14:28.408043+0000","last_active":"2024-04-26T12:14:28.407944+0000","last_peered":"2024-04-26T12:14:28.407944+0000","last_clean":"2024-04-26T12:14:28.407944+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:14:28.407944+0000","last_undegraded":"2024-04-26T12:14:28.407944+0000","last_fullsized":"2024-04-26T12:14:28.407944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.407919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.310058+0000","scrub_duration":0.0017962410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.995143+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:13:53.995143+0000","last_peered":"2024-04-26T12:13:53.995143+0000","last_clean":"2024-04-26T12:13:53.995143+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:53.995143+0000","last_undegraded":"2024-04-26T12:13:53.995143+0000","last_fullsized":"2024-04-26T12:13:53.995143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:41.919576+0000","last_change":"2024-04-26T12:14:41.919576+0000","last_active":"2024-04-26T12:14:41.919576+0000","last_peered":"2024-04-26T12:14:41.919576+0000","last_clean":"2024-04-26T12:14:41.919576+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:14:41.919576+0000","last_undegraded":"2024-04-26T12:14:41.919576+0000","last_fullsized":"2024-04-26T12:14:41.919576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.919408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:23.254496+0000","scrub_duration":0.002109872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845343+0000","last_change":"2024-04-26T12:13:14.394029+0000","last_active":"2024-04-26T12:13:34.845343+0000","last_peered":"2024-04-26T12:13:34.845343+0000","last_clean":"2024-04-26T12:13:34.845343+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:13:34.845343+0000","last_undegraded":"2024-04-26T12:13:34.845343+0000","last_fullsized":"2024-04-26T12:13:34.845343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.045205+0000","last_change":"2024-04-26T12:15:06.045313+0000","last_active":"2024-04-26T12:15:06.045205+0000","last_peered":"2024-04-26T12:15:06.045205+0000","last_clean":"2024-04-26T12:15:06.045205+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:15:06.045205+0000","last_undegraded":"2024-04-26T12:15:06.045205+0000","last_fullsized":"2024-04-26T12:15:06.045205+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.045180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:39.022762+0000","scrub_duration":0.001527748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.987377+0000","last_change":"2024-04-26T12:14:28.987377+0000","last_active":"2024-04-26T12:14:28.987377+0000","last_peered":"2024-04-26T12:14:28.987377+0000","last_clean":"2024-04-26T12:14:28.987377+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:14:28.987377+0000","last_undegraded":"2024-04-26T12:14:28.987377+0000","last_fullsized":"2024-04-26T12:14:28.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.987230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.889368+0000","scrub_duration":0.001924799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:14.918924+0000","last_change":"2024-04-26T12:14:14.918924+0000","last_active":"2024-04-26T12:14:14.918924+0000","last_peered":"2024-04-26T12:14:14.918924+0000","last_clean":"2024-04-26T12:14:14.918924+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:14:14.918924+0000","last_undegraded":"2024-04-26T12:14:14.918924+0000","last_fullsized":"2024-04-26T12:14:14.918924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_clean_scrub_stamp":"2024-04-26T12:14:14.918752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:08.147282+0000","scrub_duration":0.0020495079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'3","reported_seq":39,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.826194+0000","last_change":"2024-04-26T12:14:57.826300+0000","last_active":"2024-04-26T12:14:57.826194+0000","last_peered":"2024-04-26T12:14:57.826194+0000","last_clean":"2024-04-26T12:14:57.826194+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:14:57.826194+0000","last_undegraded":"2024-04-26T12:14:57.826194+0000","last_fullsized":"2024-04-26T12:14:57.826194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.826169+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:06.377686+0000","scrub_duration":0.0034205799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.865694+0000","last_change":"2024-04-26T12:14:55.865871+0000","last_active":"2024-04-26T12:14:55.865694+0000","last_peered":"2024-04-26T12:14:55.865694+0000","last_clean":"2024-04-26T12:14:55.865694+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:14:55.865694+0000","last_undegraded":"2024-04-26T12:14:55.865694+0000","last_fullsized":"2024-04-26T12:14:55.865694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.865666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:46.563067+0000","scrub_duration":0.036040151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'3","reported_seq":48,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.825183+0000","last_change":"2024-04-26T12:14:22.825288+0000","last_active":"2024-04-26T12:14:22.825183+0000","last_peered":"2024-04-26T12:14:22.825183+0000","last_clean":"2024-04-26T12:14:22.825183+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:14:22.825183+0000","last_undegraded":"2024-04-26T12:14:22.825183+0000","last_fullsized":"2024-04-26T12:14:22.825183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.825158+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:07.535329+0000","scrub_duration":0.0029636649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:15.751621+0000","last_change":"2024-04-26T12:15:15.751719+0000","last_active":"2024-04-26T12:15:15.751621+0000","last_peered":"2024-04-26T12:15:15.751621+0000","last_clean":"2024-04-26T12:15:15.751621+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:15:15.751621+0000","last_undegraded":"2024-04-26T12:15:15.751621+0000","last_fullsized":"2024-04-26T12:15:15.751621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:15.751598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:15.751598+0000","last_clean_scrub_stamp":"2024-04-26T12:15:15.751598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:58.908818+0000","scrub_duration":0.001834163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.233804+0000","last_change":"2024-04-26T12:14:12.233933+0000","last_active":"2024-04-26T12:14:12.233804+0000","last_peered":"2024-04-26T12:14:12.233804+0000","last_clean":"2024-04-26T12:14:12.233804+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:14:12.233804+0000","last_undegraded":"2024-04-26T12:14:12.233804+0000","last_fullsized":"2024-04-26T12:14:12.233804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.233775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:07.781137+0000","scrub_duration":0.0019158669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:23.956084+0000","last_change":"2024-04-26T12:15:23.956215+0000","last_active":"2024-04-26T12:15:23.956084+0000","last_peered":"2024-04-26T12:15:23.956084+0000","last_clean":"2024-04-26T12:15:23.956084+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:15:23.956084+0000","last_undegraded":"2024-04-26T12:15:23.956084+0000","last_fullsized":"2024-04-26T12:15:23.956084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:23.956059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:23.956059+0000","last_clean_scrub_stamp":"2024-04-26T12:15:23.956059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:00.602697+0000","scrub_duration":0.017105076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":99,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403595+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403595+0000","last_peered":"2024-04-26T12:13:51.403595+0000","last_clean":"2024-04-26T12:13:51.403595+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403595+0000","last_undegraded":"2024-04-26T12:13:51.403595+0000","last_fullsized":"2024-04-26T12:13:51.403595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798515+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798515+0000","last_peered":"2024-04-26T12:13:55.798515+0000","last_clean":"2024-04-26T12:13:55.798515+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798515+0000","last_undegraded":"2024-04-26T12:13:55.798515+0000","last_fullsized":"2024-04-26T12:13:55.798515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:59.857635+0000","last_change":"2024-04-26T12:14:59.857635+0000","last_active":"2024-04-26T12:14:59.857635+0000","last_peered":"2024-04-26T12:14:59.857635+0000","last_clean":"2024-04-26T12:14:59.857635+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:14:59.857635+0000","last_undegraded":"2024-04-26T12:14:59.857635+0000","last_fullsized":"2024-04-26T12:14:59.857635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_clean_scrub_stamp":"2024-04-26T12:14:59.857514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.374584+0000","scrub_duration":0.0018552919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406311+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406311+0000","last_peered":"2024-04-26T12:13:47.406311+0000","last_clean":"2024-04-26T12:13:47.406311+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406311+0000","last_undegraded":"2024-04-26T12:13:47.406311+0000","last_fullsized":"2024-04-26T12:13:47.406311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:11.940884+0000","last_change":"2024-04-26T12:15:11.940980+0000","last_active":"2024-04-26T12:15:11.940884+0000","last_peered":"2024-04-26T12:15:11.940884+0000","last_clean":"2024-04-26T12:15:11.940884+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:15:11.940884+0000","last_undegraded":"2024-04-26T12:15:11.940884+0000","last_fullsized":"2024-04-26T12:15:11.940884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_clean_scrub_stamp":"2024-04-26T12:15:11.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:57.982279+0000","scrub_duration":0.001908426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:03.276572+0000","last_change":"2024-04-26T12:15:03.276737+0000","last_active":"2024-04-26T12:15:03.276572+0000","last_peered":"2024-04-26T12:15:03.276572+0000","last_clean":"2024-04-26T12:15:03.276572+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:15:03.276572+0000","last_undegraded":"2024-04-26T12:15:03.276572+0000","last_fullsized":"2024-04-26T12:15:03.276572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_clean_scrub_stamp":"2024-04-26T12:15:03.276548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:41.773127+0000","scrub_duration":0.030246775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.378,"5min":0.16,"15min":0.16},"max":{"1min":0.66400000000000003,"5min":1.504,"15min":1.504},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.64300000000000002,"5min":2.383,"15min":2.383},"last":0.42899999999999999}]}]},{"osd":0,"up_from":64,"seq":274877906974,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.38300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:15:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57599999999999996,"5min":0.623,"15min":0.623},"last":0.502}]},{"osd":2,"last update":"Fri Apr 26 12:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48199999999999998,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.65500000000000003,"5min":2.214,"15min":2.214},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53000000000000003,"15min":0.44},"min":{"1min":0.40300000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.61099999999999999,"5min":2.294,"15min":2.294},"last":0.47599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:15:38.831 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.831 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.831 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.832 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.832 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.832 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.832 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.832 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.833 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:38.833 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:15:58.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:15:59.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:15:59.218 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:15:59.229 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-26T12:15:58.959098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002980"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.895460+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:13:40.895460+0000","last_peered":"2024-04-26T12:13:40.895460+0000","last_clean":"2024-04-26T12:13:40.895460+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:13:40.895460+0000","last_undegraded":"2024-04-26T12:13:40.895460+0000","last_fullsized":"2024-04-26T12:13:40.895460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:22.989975+0000","last_change":"2024-04-26T12:15:22.990086+0000","last_active":"2024-04-26T12:15:22.989975+0000","last_peered":"2024-04-26T12:15:22.989975+0000","last_clean":"2024-04-26T12:15:22.989975+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:15:22.989975+0000","last_undegraded":"2024-04-26T12:15:22.989975+0000","last_fullsized":"2024-04-26T12:15:22.989975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:22.989949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:22.989949+0000","last_clean_scrub_stamp":"2024-04-26T12:15:22.989949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:23.505337+0000","scrub_duration":0.00186264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900430+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900430+0000","last_peered":"2024-04-26T12:13:39.900430+0000","last_clean":"2024-04-26T12:13:39.900430+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900430+0000","last_undegraded":"2024-04-26T12:13:39.900430+0000","last_fullsized":"2024-04-26T12:13:39.900430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:30.560988+0000","last_change":"2024-04-26T12:15:30.561091+0000","last_active":"2024-04-26T12:15:30.560988+0000","last_peered":"2024-04-26T12:15:30.560988+0000","last_clean":"2024-04-26T12:15:30.560988+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:15:30.560988+0000","last_undegraded":"2024-04-26T12:15:30.560988+0000","last_fullsized":"2024-04-26T12:15:30.560988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:30.560966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:30.560966+0000","last_clean_scrub_stamp":"2024-04-26T12:15:30.560966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:24.644207+0000","scrub_duration":0.001942626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.957122+0000","last_change":"2024-04-26T12:14:21.957122+0000","last_active":"2024-04-26T12:14:21.957122+0000","last_peered":"2024-04-26T12:14:21.957122+0000","last_clean":"2024-04-26T12:14:21.957122+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:14:21.957122+0000","last_undegraded":"2024-04-26T12:14:21.957122+0000","last_fullsized":"2024-04-26T12:14:21.957122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.956989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.739324+0000","scrub_duration":0.017760125000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.857441+0000","last_change":"2024-04-26T12:14:30.857441+0000","last_active":"2024-04-26T12:14:30.857441+0000","last_peered":"2024-04-26T12:14:30.857441+0000","last_clean":"2024-04-26T12:14:30.857441+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:14:30.857441+0000","last_undegraded":"2024-04-26T12:14:30.857441+0000","last_fullsized":"2024-04-26T12:14:30.857441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.857300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:25.197434+0000","scrub_duration":0.0017286269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:14.796458+0000","last_change":"2024-04-26T12:15:14.796458+0000","last_active":"2024-04-26T12:15:14.796458+0000","last_peered":"2024-04-26T12:15:14.796458+0000","last_clean":"2024-04-26T12:15:14.796458+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:15:14.796458+0000","last_undegraded":"2024-04-26T12:15:14.796458+0000","last_fullsized":"2024-04-26T12:15:14.796458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:14.796316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:14.796316+0000","last_clean_scrub_stamp":"2024-04-26T12:15:14.796316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:39.641302+0000","scrub_duration":0.018361062000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:13.784060+0000","last_change":"2024-04-26T12:15:13.784060+0000","last_active":"2024-04-26T12:15:13.784060+0000","last_peered":"2024-04-26T12:15:13.784060+0000","last_clean":"2024-04-26T12:15:13.784060+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:15:13.784060+0000","last_undegraded":"2024-04-26T12:15:13.784060+0000","last_fullsized":"2024-04-26T12:15:13.784060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:13.783914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:13.783914+0000","last_clean_scrub_stamp":"2024-04-26T12:15:13.783914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:51.230549+0000","scrub_duration":0.00186824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.234851+0000","last_change":"2024-04-26T12:15:06.234993+0000","last_active":"2024-04-26T12:15:06.234851+0000","last_peered":"2024-04-26T12:15:06.234851+0000","last_clean":"2024-04-26T12:15:06.234851+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:15:06.234851+0000","last_undegraded":"2024-04-26T12:15:06.234851+0000","last_fullsized":"2024-04-26T12:15:06.234851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.234824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:39.262367+0000","scrub_duration":0.03054697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:27.017214+0000","last_change":"2024-04-26T12:14:27.017214+0000","last_active":"2024-04-26T12:14:27.017214+0000","last_peered":"2024-04-26T12:14:27.017214+0000","last_clean":"2024-04-26T12:14:27.017214+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:14:27.017214+0000","last_undegraded":"2024-04-26T12:14:27.017214+0000","last_fullsized":"2024-04-26T12:14:27.017214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_clean_scrub_stamp":"2024-04-26T12:14:27.017091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:37.663928+0000","scrub_duration":0.001639759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:29.611444+0000","last_change":"2024-04-26T12:15:29.611444+0000","last_active":"2024-04-26T12:15:29.611444+0000","last_peered":"2024-04-26T12:15:29.611444+0000","last_clean":"2024-04-26T12:15:29.611444+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:15:29.611444+0000","last_undegraded":"2024-04-26T12:15:29.611444+0000","last_fullsized":"2024-04-26T12:15:29.611444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:29.611262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:29.611262+0000","last_clean_scrub_stamp":"2024-04-26T12:15:29.611262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:58.849517+0000","scrub_duration":0.017749485999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:17.937988+0000","last_change":"2024-04-26T12:15:17.938118+0000","last_active":"2024-04-26T12:15:17.937988+0000","last_peered":"2024-04-26T12:15:17.937988+0000","last_clean":"2024-04-26T12:15:17.937988+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:15:17.937988+0000","last_undegraded":"2024-04-26T12:15:17.937988+0000","last_fullsized":"2024-04-26T12:15:17.937988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:17.937964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:17.937964+0000","last_clean_scrub_stamp":"2024-04-26T12:15:17.937964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.759628+0000","scrub_duration":0.0019884460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768255+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768255+0000","last_peered":"2024-04-26T12:13:37.768255+0000","last_clean":"2024-04-26T12:13:37.768255+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768255+0000","last_undegraded":"2024-04-26T12:13:37.768255+0000","last_fullsized":"2024-04-26T12:13:37.768255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845784+0000","last_change":"2024-04-26T12:13:14.391799+0000","last_active":"2024-04-26T12:13:34.845784+0000","last_peered":"2024-04-26T12:13:34.845784+0000","last_clean":"2024-04-26T12:13:34.845784+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:13:34.845784+0000","last_undegraded":"2024-04-26T12:13:34.845784+0000","last_fullsized":"2024-04-26T12:13:34.845784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:42.491223+0000","last_change":"2024-04-26T12:15:42.491358+0000","last_active":"2024-04-26T12:15:42.491223+0000","last_peered":"2024-04-26T12:15:42.491223+0000","last_clean":"2024-04-26T12:15:42.491223+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:15:42.491223+0000","last_undegraded":"2024-04-26T12:15:42.491223+0000","last_fullsized":"2024-04-26T12:15:42.491223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:42.491196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:42.491196+0000","last_clean_scrub_stamp":"2024-04-26T12:15:42.491196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:25.432195+0000","scrub_duration":0.001712699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:16.737298+0000","last_change":"2024-04-26T12:15:16.737298+0000","last_active":"2024-04-26T12:15:16.737298+0000","last_peered":"2024-04-26T12:15:16.737298+0000","last_clean":"2024-04-26T12:15:16.737298+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:15:16.737298+0000","last_undegraded":"2024-04-26T12:15:16.737298+0000","last_fullsized":"2024-04-26T12:15:16.737298+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:16.737138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:16.737138+0000","last_clean_scrub_stamp":"2024-04-26T12:15:16.737138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:23.146620+0000","scrub_duration":0.001865359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:04.332453+0000","last_change":"2024-04-26T12:15:04.332686+0000","last_active":"2024-04-26T12:15:04.332453+0000","last_peered":"2024-04-26T12:15:04.332453+0000","last_clean":"2024-04-26T12:15:04.332453+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:15:04.332453+0000","last_undegraded":"2024-04-26T12:15:04.332453+0000","last_fullsized":"2024-04-26T12:15:04.332453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_clean_scrub_stamp":"2024-04-26T12:15:04.332430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:30.932618+0000","scrub_duration":0.085013177999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:07.011617+0000","last_change":"2024-04-26T12:15:07.011766+0000","last_active":"2024-04-26T12:15:07.011617+0000","last_peered":"2024-04-26T12:15:07.011617+0000","last_clean":"2024-04-26T12:15:07.011617+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:15:07.011617+0000","last_undegraded":"2024-04-26T12:15:07.011617+0000","last_fullsized":"2024-04-26T12:15:07.011617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_clean_scrub_stamp":"2024-04-26T12:15:07.011593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:28.154774+0000","scrub_duration":0.0018777920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:13.303269+0000","last_change":"2024-04-26T12:14:13.303269+0000","last_active":"2024-04-26T12:14:13.303269+0000","last_peered":"2024-04-26T12:14:13.303269+0000","last_clean":"2024-04-26T12:14:13.303269+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:14:13.303269+0000","last_undegraded":"2024-04-26T12:14:13.303269+0000","last_fullsized":"2024-04-26T12:14:13.303269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_clean_scrub_stamp":"2024-04-26T12:14:13.303081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.143477+0000","scrub_duration":0.030270521000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.939043+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.939043+0000","last_peered":"2024-04-26T12:14:06.939043+0000","last_clean":"2024-04-26T12:14:06.939043+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.939043+0000","last_undegraded":"2024-04-26T12:14:06.939043+0000","last_fullsized":"2024-04-26T12:14:06.939043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:24.762804+0000","last_change":"2024-04-26T12:15:24.762804+0000","last_active":"2024-04-26T12:15:24.762804+0000","last_peered":"2024-04-26T12:15:24.762804+0000","last_clean":"2024-04-26T12:15:24.762804+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:15:24.762804+0000","last_undegraded":"2024-04-26T12:15:24.762804+0000","last_fullsized":"2024-04-26T12:15:24.762804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:24.762636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:24.762636+0000","last_clean_scrub_stamp":"2024-04-26T12:15:24.762636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:38.325160+0000","scrub_duration":0.026021782,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945792+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945792+0000","last_peered":"2024-04-26T12:13:55.945792+0000","last_clean":"2024-04-26T12:13:55.945792+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945792+0000","last_undegraded":"2024-04-26T12:13:55.945792+0000","last_fullsized":"2024-04-26T12:13:55.945792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.353952+0000","last_change":"2024-04-26T12:14:56.354059+0000","last_active":"2024-04-26T12:14:56.353952+0000","last_peered":"2024-04-26T12:14:56.353952+0000","last_clean":"2024-04-26T12:14:56.353952+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:14:56.353952+0000","last_undegraded":"2024-04-26T12:14:56.353952+0000","last_fullsized":"2024-04-26T12:14:56.353952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.353928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:28.867805+0000","scrub_duration":0.0017401999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:02.259695+0000","last_change":"2024-04-26T12:15:02.259805+0000","last_active":"2024-04-26T12:15:02.259695+0000","last_peered":"2024-04-26T12:15:02.259695+0000","last_clean":"2024-04-26T12:15:02.259695+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:15:02.259695+0000","last_undegraded":"2024-04-26T12:15:02.259695+0000","last_fullsized":"2024-04-26T12:15:02.259695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_clean_scrub_stamp":"2024-04-26T12:15:02.259669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:17.697891+0000","scrub_duration":0.0016369970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845626+0000","last_change":"2024-04-26T12:13:14.394475+0000","last_active":"2024-04-26T12:13:34.845626+0000","last_peered":"2024-04-26T12:13:34.845626+0000","last_clean":"2024-04-26T12:13:34.845626+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:13:34.845626+0000","last_undegraded":"2024-04-26T12:13:34.845626+0000","last_fullsized":"2024-04-26T12:13:34.845626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.065209+0000","last_change":"2024-04-26T12:14:57.065316+0000","last_active":"2024-04-26T12:14:57.065209+0000","last_peered":"2024-04-26T12:14:57.065209+0000","last_clean":"2024-04-26T12:14:57.065209+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:14:57.065209+0000","last_undegraded":"2024-04-26T12:14:57.065209+0000","last_fullsized":"2024-04-26T12:14:57.065209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.065182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:12.857856+0000","scrub_duration":0.001780539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963249+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963249+0000","last_peered":"2024-04-26T12:13:54.963249+0000","last_clean":"2024-04-26T12:13:54.963249+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963249+0000","last_undegraded":"2024-04-26T12:13:54.963249+0000","last_fullsized":"2024-04-26T12:13:54.963249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384596+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384596+0000","last_peered":"2024-04-26T12:13:56.384596+0000","last_clean":"2024-04-26T12:13:56.384596+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384596+0000","last_undegraded":"2024-04-26T12:13:56.384596+0000","last_fullsized":"2024-04-26T12:13:56.384596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.342633+0000","last_change":"2024-04-26T12:14:55.342633+0000","last_active":"2024-04-26T12:14:55.342633+0000","last_peered":"2024-04-26T12:14:55.342633+0000","last_clean":"2024-04-26T12:14:55.342633+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:14:55.342633+0000","last_undegraded":"2024-04-26T12:14:55.342633+0000","last_fullsized":"2024-04-26T12:14:55.342633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.342504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.330593+0000","scrub_duration":0.001697816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345322+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345322+0000","last_peered":"2024-04-26T12:14:06.345322+0000","last_clean":"2024-04-26T12:14:06.345322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345322+0000","last_undegraded":"2024-04-26T12:14:06.345322+0000","last_fullsized":"2024-04-26T12:14:06.345322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.973075+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:13:46.973075+0000","last_peered":"2024-04-26T12:13:46.973075+0000","last_clean":"2024-04-26T12:13:46.973075+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:13:46.973075+0000","last_undegraded":"2024-04-26T12:13:46.973075+0000","last_fullsized":"2024-04-26T12:13:46.973075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:15.275693+0000","last_change":"2024-04-26T12:14:15.275693+0000","last_active":"2024-04-26T12:14:15.275693+0000","last_peered":"2024-04-26T12:14:15.275693+0000","last_clean":"2024-04-26T12:14:15.275693+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:14:15.275693+0000","last_undegraded":"2024-04-26T12:14:15.275693+0000","last_fullsized":"2024-04-26T12:14:15.275693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_clean_scrub_stamp":"2024-04-26T12:14:15.275528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:03.816301+0000","scrub_duration":0.0017978549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448534+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448534+0000","last_peered":"2024-04-26T12:13:40.448534+0000","last_clean":"2024-04-26T12:13:40.448534+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448534+0000","last_undegraded":"2024-04-26T12:13:40.448534+0000","last_fullsized":"2024-04-26T12:13:40.448534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.969053+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.969053+0000","last_peered":"2024-04-26T12:14:08.969053+0000","last_clean":"2024-04-26T12:14:08.969053+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.969053+0000","last_undegraded":"2024-04-26T12:14:08.969053+0000","last_fullsized":"2024-04-26T12:14:08.969053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.429010+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.429010+0000","last_peered":"2024-04-26T12:13:55.429010+0000","last_clean":"2024-04-26T12:13:55.429010+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.429010+0000","last_undegraded":"2024-04-26T12:13:55.429010+0000","last_fullsized":"2024-04-26T12:13:55.429010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'5","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:05.050139+0000","last_change":"2024-04-26T12:15:05.050238+0000","last_active":"2024-04-26T12:15:05.050139+0000","last_peered":"2024-04-26T12:15:05.050139+0000","last_clean":"2024-04-26T12:15:05.050139+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:15:05.050139+0000","last_undegraded":"2024-04-26T12:15:05.050139+0000","last_fullsized":"2024-04-26T12:15:05.050139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'5","last_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_deep_scrub":"71'5","last_deep_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_clean_scrub_stamp":"2024-04-26T12:15:05.050114+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.650303+0000","scrub_duration":0.0036686359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448329+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448329+0000","last_peered":"2024-04-26T12:13:38.448329+0000","last_clean":"2024-04-26T12:13:38.448329+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448329+0000","last_undegraded":"2024-04-26T12:13:38.448329+0000","last_fullsized":"2024-04-26T12:13:38.448329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"71'10","reported_seq":48,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:49.478185+0000","last_change":"2024-04-26T12:15:49.478281+0000","last_active":"2024-04-26T12:15:49.478185+0000","last_peered":"2024-04-26T12:15:49.478185+0000","last_clean":"2024-04-26T12:15:49.478185+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:15:49.478185+0000","last_undegraded":"2024-04-26T12:15:49.478185+0000","last_fullsized":"2024-04-26T12:15:49.478185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-04-26T12:15:49.478158+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-04-26T12:15:49.478158+0000","last_clean_scrub_stamp":"2024-04-26T12:15:49.478158+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:51.973560+0000","scrub_duration":0.0043457770000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845521+0000","last_change":"2024-04-26T12:13:14.394298+0000","last_active":"2024-04-26T12:13:34.845521+0000","last_peered":"2024-04-26T12:13:34.845521+0000","last_clean":"2024-04-26T12:13:34.845521+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:13:34.845521+0000","last_undegraded":"2024-04-26T12:13:34.845521+0000","last_fullsized":"2024-04-26T12:13:34.845521+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:48.915147+0000","last_clean_scrub_stamp":"2024-04-26T12:09:48.915147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'4","reported_seq":41,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:33.842822+0000","last_change":"2024-04-26T12:14:33.842822+0000","last_active":"2024-04-26T12:14:33.842822+0000","last_peered":"2024-04-26T12:14:33.842822+0000","last_clean":"2024-04-26T12:14:33.842822+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:14:33.842822+0000","last_undegraded":"2024-04-26T12:14:33.842822+0000","last_fullsized":"2024-04-26T12:14:33.842822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_clean_scrub_stamp":"2024-04-26T12:14:33.842693+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:46.697373+0000","scrub_duration":0.0037628990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863656+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863656+0000","last_peered":"2024-04-26T12:13:43.863656+0000","last_clean":"2024-04-26T12:13:43.863656+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863656+0000","last_undegraded":"2024-04-26T12:13:43.863656+0000","last_fullsized":"2024-04-26T12:13:43.863656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.368067+0000","last_change":"2024-04-26T12:14:35.368170+0000","last_active":"2024-04-26T12:14:35.368067+0000","last_peered":"2024-04-26T12:14:35.368067+0000","last_clean":"2024-04-26T12:14:35.368067+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:14:35.368067+0000","last_undegraded":"2024-04-26T12:14:35.368067+0000","last_fullsized":"2024-04-26T12:14:35.368067+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.368043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:47.502525+0000","scrub_duration":0.001810372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916478+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916478+0000","last_peered":"2024-04-26T12:13:45.916478+0000","last_clean":"2024-04-26T12:13:45.916478+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916478+0000","last_undegraded":"2024-04-26T12:13:45.916478+0000","last_fullsized":"2024-04-26T12:13:45.916478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994111+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994111+0000","last_peered":"2024-04-26T12:14:11.994111+0000","last_clean":"2024-04-26T12:14:11.994111+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994111+0000","last_undegraded":"2024-04-26T12:14:11.994111+0000","last_fullsized":"2024-04-26T12:14:11.994111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433336+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433336+0000","last_peered":"2024-04-26T12:13:46.433336+0000","last_clean":"2024-04-26T12:13:46.433336+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433336+0000","last_undegraded":"2024-04-26T12:13:46.433336+0000","last_fullsized":"2024-04-26T12:13:46.433336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'12","reported_seq":47,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.841922+0000","last_change":"2024-04-26T12:14:18.841922+0000","last_active":"2024-04-26T12:14:18.841922+0000","last_peered":"2024-04-26T12:14:18.841922+0000","last_clean":"2024-04-26T12:14:18.841922+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:14:18.841922+0000","last_undegraded":"2024-04-26T12:14:18.841922+0000","last_fullsized":"2024-04-26T12:14:18.841922+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.841792+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:13.987239+0000","scrub_duration":0.0044348529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433157+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433157+0000","last_peered":"2024-04-26T12:13:48.433157+0000","last_clean":"2024-04-26T12:13:48.433157+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433157+0000","last_undegraded":"2024-04-26T12:13:48.433157+0000","last_fullsized":"2024-04-26T12:13:48.433157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"71'2","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:53.469952+0000","last_change":"2024-04-26T12:15:53.470075+0000","last_active":"2024-04-26T12:15:53.469952+0000","last_peered":"2024-04-26T12:15:53.469952+0000","last_clean":"2024-04-26T12:15:53.469952+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:15:53.469952+0000","last_undegraded":"2024-04-26T12:15:53.469952+0000","last_fullsized":"2024-04-26T12:15:53.469952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:15:53.469927+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:15:53.469927+0000","last_clean_scrub_stamp":"2024-04-26T12:15:53.469927+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:32.131461+0000","scrub_duration":0.0032387370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:13.928108+0000","last_change":"2024-04-26T12:15:13.928200+0000","last_active":"2024-04-26T12:15:13.928108+0000","last_peered":"2024-04-26T12:15:13.928108+0000","last_clean":"2024-04-26T12:15:13.928108+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:15:13.928108+0000","last_undegraded":"2024-04-26T12:15:13.928108+0000","last_fullsized":"2024-04-26T12:15:13.928108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:13.928083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:13.928083+0000","last_clean_scrub_stamp":"2024-04-26T12:15:13.928083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:45.700894+0000","scrub_duration":0.0017930660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.959426+0000","last_change":"2024-04-26T12:14:22.959531+0000","last_active":"2024-04-26T12:14:22.959426+0000","last_peered":"2024-04-26T12:14:22.959426+0000","last_clean":"2024-04-26T12:14:22.959426+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:14:22.959426+0000","last_undegraded":"2024-04-26T12:14:22.959426+0000","last_fullsized":"2024-04-26T12:14:22.959426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.959400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.893413+0000","scrub_duration":0.0031299650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:10.948171+0000","last_change":"2024-04-26T12:15:10.948276+0000","last_active":"2024-04-26T12:15:10.948171+0000","last_peered":"2024-04-26T12:15:10.948171+0000","last_clean":"2024-04-26T12:15:10.948171+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:15:10.948171+0000","last_undegraded":"2024-04-26T12:15:10.948171+0000","last_fullsized":"2024-04-26T12:15:10.948171+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_clean_scrub_stamp":"2024-04-26T12:15:10.948146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:24.938423+0000","scrub_duration":0.001742684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'2","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.903851+0000","last_change":"2024-04-26T12:14:12.903851+0000","last_active":"2024-04-26T12:14:12.903851+0000","last_peered":"2024-04-26T12:14:12.903851+0000","last_clean":"2024-04-26T12:14:12.903851+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:14:12.903851+0000","last_undegraded":"2024-04-26T12:14:12.903851+0000","last_fullsized":"2024-04-26T12:14:12.903851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.903685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:26.642032+0000","scrub_duration":0.0032440770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879159+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879159+0000","last_peered":"2024-04-26T12:13:47.879159+0000","last_clean":"2024-04-26T12:13:47.879159+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879159+0000","last_undegraded":"2024-04-26T12:13:47.879159+0000","last_fullsized":"2024-04-26T12:13:47.879159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:34.845270+0000","last_change":"2024-04-26T12:13:14.394283+0000","last_active":"2024-04-26T12:13:34.845270+0000","last_peered":"2024-04-26T12:13:34.845270+0000","last_clean":"2024-04-26T12:13:34.845270+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:13:34.845270+0000","last_undegraded":"2024-04-26T12:13:34.845270+0000","last_fullsized":"2024-04-26T12:13:34.845270+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:09:47.913444+0000","last_clean_scrub_stamp":"2024-04-26T12:09:47.913444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.481077+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.481077+0000","last_peered":"2024-04-26T12:13:39.481077+0000","last_clean":"2024-04-26T12:13:39.481077+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.481077+0000","last_undegraded":"2024-04-26T12:13:39.481077+0000","last_fullsized":"2024-04-26T12:13:39.481077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.339693+0000","last_change":"2024-04-26T12:14:22.339818+0000","last_active":"2024-04-26T12:14:22.339693+0000","last_peered":"2024-04-26T12:14:22.339693+0000","last_clean":"2024-04-26T12:14:22.339693+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:14:22.339693+0000","last_undegraded":"2024-04-26T12:14:22.339693+0000","last_fullsized":"2024-04-26T12:14:22.339693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.339667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.273680+0000","scrub_duration":0.003330211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.889408+0000","last_change":"2024-04-26T12:14:35.889408+0000","last_active":"2024-04-26T12:14:35.889408+0000","last_peered":"2024-04-26T12:14:35.889408+0000","last_clean":"2024-04-26T12:14:35.889408+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:14:35.889408+0000","last_undegraded":"2024-04-26T12:14:35.889408+0000","last_fullsized":"2024-04-26T12:14:35.889408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.889249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.444942+0000","scrub_duration":0.0023221090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:38.537459+0000","last_change":"2024-04-26T12:15:38.537590+0000","last_active":"2024-04-26T12:15:38.537459+0000","last_peered":"2024-04-26T12:15:38.537459+0000","last_clean":"2024-04-26T12:15:38.537459+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:15:38.537459+0000","last_undegraded":"2024-04-26T12:15:38.537459+0000","last_fullsized":"2024-04-26T12:15:38.537459+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:38.537437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:38.537437+0000","last_clean_scrub_stamp":"2024-04-26T12:15:38.537437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:06:10.933648+0000","scrub_duration":0.0020280469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.865071+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.865071+0000","last_peered":"2024-04-26T12:13:37.865071+0000","last_clean":"2024-04-26T12:13:37.865071+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.865071+0000","last_undegraded":"2024-04-26T12:13:37.865071+0000","last_fullsized":"2024-04-26T12:13:37.865071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:01.114069+0000","last_change":"2024-04-26T12:15:01.114240+0000","last_active":"2024-04-26T12:15:01.114069+0000","last_peered":"2024-04-26T12:15:01.114069+0000","last_clean":"2024-04-26T12:15:01.114069+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:15:01.114069+0000","last_undegraded":"2024-04-26T12:15:01.114069+0000","last_fullsized":"2024-04-26T12:15:01.114069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_clean_scrub_stamp":"2024-04-26T12:15:01.114045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:29.694980+0000","scrub_duration":0.0020529889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.824242+0000","last_change":"2024-04-26T12:14:28.824242+0000","last_active":"2024-04-26T12:14:28.824242+0000","last_peered":"2024-04-26T12:14:28.824242+0000","last_clean":"2024-04-26T12:14:28.824242+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:14:28.824242+0000","last_undegraded":"2024-04-26T12:14:28.824242+0000","last_fullsized":"2024-04-26T12:14:28.824242+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.824076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:03.088647+0000","scrub_duration":0.001938574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.943962+0000","last_change":"2024-04-26T12:14:18.944074+0000","last_active":"2024-04-26T12:14:18.943962+0000","last_peered":"2024-04-26T12:14:18.943962+0000","last_clean":"2024-04-26T12:14:18.943962+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:14:18.943962+0000","last_undegraded":"2024-04-26T12:14:18.943962+0000","last_fullsized":"2024-04-26T12:14:18.943962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.943939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:15.950995+0000","scrub_duration":0.001622535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.435152+0000","last_change":"2024-04-26T12:14:57.435295+0000","last_active":"2024-04-26T12:14:57.435152+0000","last_peered":"2024-04-26T12:14:57.435152+0000","last_clean":"2024-04-26T12:14:57.435152+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:14:57.435152+0000","last_undegraded":"2024-04-26T12:14:57.435152+0000","last_fullsized":"2024-04-26T12:14:57.435152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.435128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:29.486293+0000","scrub_duration":0.059299769000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"71'3","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:26.352731+0000","last_change":"2024-04-26T12:14:26.352850+0000","last_active":"2024-04-26T12:14:26.352731+0000","last_peered":"2024-04-26T12:14:26.352731+0000","last_clean":"2024-04-26T12:14:26.352731+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:14:26.352731+0000","last_undegraded":"2024-04-26T12:14:26.352731+0000","last_fullsized":"2024-04-26T12:14:26.352731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_clean_scrub_stamp":"2024-04-26T12:14:26.352705+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:36.999542+0000","scrub_duration":0.0032761019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.970459+0000","last_change":"2024-04-26T12:14:35.970590+0000","last_active":"2024-04-26T12:14:35.970459+0000","last_peered":"2024-04-26T12:14:35.970459+0000","last_clean":"2024-04-26T12:14:35.970459+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:14:35.970459+0000","last_undegraded":"2024-04-26T12:14:35.970459+0000","last_fullsized":"2024-04-26T12:14:35.970459+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.970433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:48.104915+0000","scrub_duration":0.0018752809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344901+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344901+0000","last_peered":"2024-04-26T12:14:08.344901+0000","last_clean":"2024-04-26T12:14:08.344901+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344901+0000","last_undegraded":"2024-04-26T12:14:08.344901+0000","last_fullsized":"2024-04-26T12:14:08.344901+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.943214+0000","last_change":"2024-04-26T12:14:50.943331+0000","last_active":"2024-04-26T12:14:50.943214+0000","last_peered":"2024-04-26T12:14:50.943214+0000","last_clean":"2024-04-26T12:14:50.943214+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:14:50.943214+0000","last_undegraded":"2024-04-26T12:14:50.943214+0000","last_fullsized":"2024-04-26T12:14:50.943214+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.943190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.740367+0000","scrub_duration":0.001687745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'2","reported_seq":95,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.465557+0000","last_change":"2024-04-26T12:14:30.465659+0000","last_active":"2024-04-26T12:14:30.465557+0000","last_peered":"2024-04-26T12:14:30.465557+0000","last_clean":"2024-04-26T12:14:30.465557+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:14:30.465557+0000","last_undegraded":"2024-04-26T12:14:30.465557+0000","last_fullsized":"2024-04-26T12:14:30.465557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.465530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:48.739313+0000","scrub_duration":0.0032107360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985324+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985324+0000","last_peered":"2024-04-26T12:14:02.985324+0000","last_clean":"2024-04-26T12:14:02.985324+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985324+0000","last_undegraded":"2024-04-26T12:14:02.985324+0000","last_fullsized":"2024-04-26T12:14:02.985324+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:19.306128+0000","last_change":"2024-04-26T12:14:19.306228+0000","last_active":"2024-04-26T12:14:19.306128+0000","last_peered":"2024-04-26T12:14:19.306128+0000","last_clean":"2024-04-26T12:14:19.306128+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:14:19.306128+0000","last_undegraded":"2024-04-26T12:14:19.306128+0000","last_fullsized":"2024-04-26T12:14:19.306128+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_clean_scrub_stamp":"2024-04-26T12:14:19.306105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:16.313160+0000","scrub_duration":0.00185067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":235,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764139+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764139+0000","last_peered":"2024-04-26T12:13:57.764139+0000","last_clean":"2024-04-26T12:13:57.764139+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764139+0000","last_undegraded":"2024-04-26T12:13:57.764139+0000","last_fullsized":"2024-04-26T12:13:57.764139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:20.284951+0000","last_change":"2024-04-26T12:14:20.285067+0000","last_active":"2024-04-26T12:14:20.284951+0000","last_peered":"2024-04-26T12:14:20.284951+0000","last_clean":"2024-04-26T12:14:20.284951+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:14:20.284951+0000","last_undegraded":"2024-04-26T12:14:20.284951+0000","last_fullsized":"2024-04-26T12:14:20.284951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_clean_scrub_stamp":"2024-04-26T12:14:20.284929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:17.159266+0000","scrub_duration":0.0019985570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803474+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803474+0000","last_peered":"2024-04-26T12:13:53.803474+0000","last_clean":"2024-04-26T12:13:53.803474+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803474+0000","last_undegraded":"2024-04-26T12:13:53.803474+0000","last_fullsized":"2024-04-26T12:13:53.803474+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.079764+0000","last_change":"2024-04-26T12:14:56.079764+0000","last_active":"2024-04-26T12:14:56.079764+0000","last_peered":"2024-04-26T12:14:56.079764+0000","last_clean":"2024-04-26T12:14:56.079764+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:14:56.079764+0000","last_undegraded":"2024-04-26T12:14:56.079764+0000","last_fullsized":"2024-04-26T12:14:56.079764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.079578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:15.852956+0000","scrub_duration":0.0019403910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.463778+0000","last_change":"2024-04-26T12:14:50.463905+0000","last_active":"2024-04-26T12:14:50.463778+0000","last_peered":"2024-04-26T12:14:50.463778+0000","last_clean":"2024-04-26T12:14:50.463778+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:14:50.463778+0000","last_undegraded":"2024-04-26T12:14:50.463778+0000","last_fullsized":"2024-04-26T12:14:50.463778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.463714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.260891+0000","scrub_duration":0.030635608000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833572+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833572+0000","last_peered":"2024-04-26T12:13:42.833572+0000","last_clean":"2024-04-26T12:13:42.833572+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833572+0000","last_undegraded":"2024-04-26T12:13:42.833572+0000","last_fullsized":"2024-04-26T12:13:42.833572+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.332054+0000","last_change":"2024-04-26T12:14:21.332157+0000","last_active":"2024-04-26T12:14:21.332054+0000","last_peered":"2024-04-26T12:14:21.332054+0000","last_clean":"2024-04-26T12:14:21.332054+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:14:21.332054+0000","last_undegraded":"2024-04-26T12:14:21.332054+0000","last_fullsized":"2024-04-26T12:14:21.332054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.332028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.114364+0000","scrub_duration":0.001618303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:52.893734+0000","last_change":"2024-04-26T12:14:52.893734+0000","last_active":"2024-04-26T12:14:52.893734+0000","last_peered":"2024-04-26T12:14:52.893734+0000","last_clean":"2024-04-26T12:14:52.893734+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:14:52.893734+0000","last_undegraded":"2024-04-26T12:14:52.893734+0000","last_fullsized":"2024-04-26T12:14:52.893734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_clean_scrub_stamp":"2024-04-26T12:14:52.893586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:40.019384+0000","scrub_duration":0.0019374699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.983564+0000","last_change":"2024-04-26T12:14:30.983701+0000","last_active":"2024-04-26T12:14:30.983564+0000","last_peered":"2024-04-26T12:14:30.983564+0000","last_clean":"2024-04-26T12:14:30.983564+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:14:30.983564+0000","last_undegraded":"2024-04-26T12:14:30.983564+0000","last_fullsized":"2024-04-26T12:14:30.983564+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.983541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:49.257324+0000","scrub_duration":0.001498107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.891919+0000","last_change":"2024-04-26T12:14:40.891919+0000","last_active":"2024-04-26T12:14:40.891919+0000","last_peered":"2024-04-26T12:14:40.891919+0000","last_clean":"2024-04-26T12:14:40.891919+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:14:40.891919+0000","last_undegraded":"2024-04-26T12:14:40.891919+0000","last_fullsized":"2024-04-26T12:14:40.891919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_clean_scrub_stamp":"2024-04-26T12:14:40.891766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:11.805668+0000","scrub_duration":0.0015939929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300236+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300236+0000","last_peered":"2024-04-26T12:14:05.300236+0000","last_clean":"2024-04-26T12:14:05.300236+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300236+0000","last_undegraded":"2024-04-26T12:14:05.300236+0000","last_fullsized":"2024-04-26T12:14:05.300236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":97,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.033361+0000","last_change":"2024-04-26T12:14:55.033468+0000","last_active":"2024-04-26T12:14:55.033361+0000","last_peered":"2024-04-26T12:14:55.033361+0000","last_clean":"2024-04-26T12:14:55.033361+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:14:55.033361+0000","last_undegraded":"2024-04-26T12:14:55.033361+0000","last_fullsized":"2024-04-26T12:14:55.033361+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.033339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.021427+0000","scrub_duration":0.001908943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.407944+0000","last_change":"2024-04-26T12:14:28.408043+0000","last_active":"2024-04-26T12:14:28.407944+0000","last_peered":"2024-04-26T12:14:28.407944+0000","last_clean":"2024-04-26T12:14:28.407944+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:14:28.407944+0000","last_undegraded":"2024-04-26T12:14:28.407944+0000","last_fullsized":"2024-04-26T12:14:28.407944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.407919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.310058+0000","scrub_duration":0.0017962410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.995143+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:13:53.995143+0000","last_peered":"2024-04-26T12:13:53.995143+0000","last_clean":"2024-04-26T12:13:53.995143+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:13:53.995143+0000","last_undegraded":"2024-04-26T12:13:53.995143+0000","last_fullsized":"2024-04-26T12:13:53.995143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:41.919576+0000","last_change":"2024-04-26T12:14:41.919576+0000","last_active":"2024-04-26T12:14:41.919576+0000","last_peered":"2024-04-26T12:14:41.919576+0000","last_clean":"2024-04-26T12:14:41.919576+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:14:41.919576+0000","last_undegraded":"2024-04-26T12:14:41.919576+0000","last_fullsized":"2024-04-26T12:14:41.919576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.919408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:23.254496+0000","scrub_duration":0.002109872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:37.489062+0000","last_change":"2024-04-26T12:15:37.489165+0000","last_active":"2024-04-26T12:15:37.489062+0000","last_peered":"2024-04-26T12:15:37.489062+0000","last_clean":"2024-04-26T12:15:37.489062+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:15:37.489062+0000","last_undegraded":"2024-04-26T12:15:37.489062+0000","last_fullsized":"2024-04-26T12:15:37.489062+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:37.489039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:37.489039+0000","last_clean_scrub_stamp":"2024-04-26T12:15:37.489039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:50.510957+0000","scrub_duration":0.0018591510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.045205+0000","last_change":"2024-04-26T12:15:06.045313+0000","last_active":"2024-04-26T12:15:06.045205+0000","last_peered":"2024-04-26T12:15:06.045205+0000","last_clean":"2024-04-26T12:15:06.045205+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:15:06.045205+0000","last_undegraded":"2024-04-26T12:15:06.045205+0000","last_fullsized":"2024-04-26T12:15:06.045205+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.045180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:39.022762+0000","scrub_duration":0.001527748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.987377+0000","last_change":"2024-04-26T12:14:28.987377+0000","last_active":"2024-04-26T12:14:28.987377+0000","last_peered":"2024-04-26T12:14:28.987377+0000","last_clean":"2024-04-26T12:14:28.987377+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:14:28.987377+0000","last_undegraded":"2024-04-26T12:14:28.987377+0000","last_fullsized":"2024-04-26T12:14:28.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.987230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.889368+0000","scrub_duration":0.001924799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:14.918924+0000","last_change":"2024-04-26T12:14:14.918924+0000","last_active":"2024-04-26T12:14:14.918924+0000","last_peered":"2024-04-26T12:14:14.918924+0000","last_clean":"2024-04-26T12:14:14.918924+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:14:14.918924+0000","last_undegraded":"2024-04-26T12:14:14.918924+0000","last_fullsized":"2024-04-26T12:14:14.918924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_clean_scrub_stamp":"2024-04-26T12:14:14.918752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:08.147282+0000","scrub_duration":0.0020495079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'3","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.826300+0000","last_change":"2024-04-26T12:14:57.826300+0000","last_active":"2024-04-26T12:14:57.826300+0000","last_peered":"2024-04-26T12:14:57.826300+0000","last_clean":"2024-04-26T12:14:57.826300+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:14:57.826300+0000","last_undegraded":"2024-04-26T12:14:57.826300+0000","last_fullsized":"2024-04-26T12:14:57.826300+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.826169+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:06.377686+0000","scrub_duration":0.0034205799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.865871+0000","last_change":"2024-04-26T12:14:55.865871+0000","last_active":"2024-04-26T12:14:55.865871+0000","last_peered":"2024-04-26T12:14:55.865871+0000","last_clean":"2024-04-26T12:14:55.865871+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:14:55.865871+0000","last_undegraded":"2024-04-26T12:14:55.865871+0000","last_fullsized":"2024-04-26T12:14:55.865871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.865666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:46.563067+0000","scrub_duration":0.036040151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'3","reported_seq":49,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.825288+0000","last_change":"2024-04-26T12:14:22.825288+0000","last_active":"2024-04-26T12:14:22.825288+0000","last_peered":"2024-04-26T12:14:22.825288+0000","last_clean":"2024-04-26T12:14:22.825288+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:14:22.825288+0000","last_undegraded":"2024-04-26T12:14:22.825288+0000","last_fullsized":"2024-04-26T12:14:22.825288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.825158+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:07.535329+0000","scrub_duration":0.0029636649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:15.751719+0000","last_change":"2024-04-26T12:15:15.751719+0000","last_active":"2024-04-26T12:15:15.751719+0000","last_peered":"2024-04-26T12:15:15.751719+0000","last_clean":"2024-04-26T12:15:15.751719+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:15:15.751719+0000","last_undegraded":"2024-04-26T12:15:15.751719+0000","last_fullsized":"2024-04-26T12:15:15.751719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:15.751598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:15.751598+0000","last_clean_scrub_stamp":"2024-04-26T12:15:15.751598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:58.908818+0000","scrub_duration":0.001834163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.233933+0000","last_change":"2024-04-26T12:14:12.233933+0000","last_active":"2024-04-26T12:14:12.233933+0000","last_peered":"2024-04-26T12:14:12.233933+0000","last_clean":"2024-04-26T12:14:12.233933+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:14:12.233933+0000","last_undegraded":"2024-04-26T12:14:12.233933+0000","last_fullsized":"2024-04-26T12:14:12.233933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.233775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:07.781137+0000","scrub_duration":0.0019158669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:23.956084+0000","last_change":"2024-04-26T12:15:23.956215+0000","last_active":"2024-04-26T12:15:23.956084+0000","last_peered":"2024-04-26T12:15:23.956084+0000","last_clean":"2024-04-26T12:15:23.956084+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:15:23.956084+0000","last_undegraded":"2024-04-26T12:15:23.956084+0000","last_fullsized":"2024-04-26T12:15:23.956084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:23.956059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:23.956059+0000","last_clean_scrub_stamp":"2024-04-26T12:15:23.956059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:00.602697+0000","scrub_duration":0.017105076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":99,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.403595+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:13:51.403595+0000","last_peered":"2024-04-26T12:13:51.403595+0000","last_clean":"2024-04-26T12:13:51.403595+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:13:51.403595+0000","last_undegraded":"2024-04-26T12:13:51.403595+0000","last_fullsized":"2024-04-26T12:13:51.403595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798629+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798629+0000","last_peered":"2024-04-26T12:13:55.798629+0000","last_clean":"2024-04-26T12:13:55.798629+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798629+0000","last_undegraded":"2024-04-26T12:13:55.798629+0000","last_fullsized":"2024-04-26T12:13:55.798629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:59.857635+0000","last_change":"2024-04-26T12:14:59.857635+0000","last_active":"2024-04-26T12:14:59.857635+0000","last_peered":"2024-04-26T12:14:59.857635+0000","last_clean":"2024-04-26T12:14:59.857635+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:14:59.857635+0000","last_undegraded":"2024-04-26T12:14:59.857635+0000","last_fullsized":"2024-04-26T12:14:59.857635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_clean_scrub_stamp":"2024-04-26T12:14:59.857514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.374584+0000","scrub_duration":0.0018552919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.406311+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:13:47.406311+0000","last_peered":"2024-04-26T12:13:47.406311+0000","last_clean":"2024-04-26T12:13:47.406311+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:13:47.406311+0000","last_undegraded":"2024-04-26T12:13:47.406311+0000","last_fullsized":"2024-04-26T12:13:47.406311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:11.940884+0000","last_change":"2024-04-26T12:15:11.940980+0000","last_active":"2024-04-26T12:15:11.940884+0000","last_peered":"2024-04-26T12:15:11.940884+0000","last_clean":"2024-04-26T12:15:11.940884+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:15:11.940884+0000","last_undegraded":"2024-04-26T12:15:11.940884+0000","last_fullsized":"2024-04-26T12:15:11.940884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_clean_scrub_stamp":"2024-04-26T12:15:11.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:57.982279+0000","scrub_duration":0.001908426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:03.276572+0000","last_change":"2024-04-26T12:15:03.276737+0000","last_active":"2024-04-26T12:15:03.276572+0000","last_peered":"2024-04-26T12:15:03.276572+0000","last_clean":"2024-04-26T12:15:03.276572+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:15:03.276572+0000","last_undegraded":"2024-04-26T12:15:03.276572+0000","last_fullsized":"2024-04-26T12:15:03.276572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_clean_scrub_stamp":"2024-04-26T12:15:03.276548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:41.773127+0000","scrub_duration":0.030246775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738446,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.441},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.378,"5min":0.16,"15min":0.16},"max":{"1min":0.66400000000000003,"5min":1.504,"15min":1.504},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50600000000000001,"15min":0.56399999999999995},"min":{"1min":0.39800000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.64300000000000002,"5min":2.383,"15min":2.383},"last":0.53600000000000003}]}]},{"osd":0,"up_from":64,"seq":274877906979,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.498},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.57599999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:15:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57599999999999996,"5min":0.623,"15min":0.623},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.43099999999999999},"min":{"1min":0.36499999999999999,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.59299999999999997,"5min":2.214,"15min":2.214},"last":0.436},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.44700000000000001},"min":{"1min":0.34000000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.59099999999999997,"5min":2.294,"15min":2.294},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:15:59.235 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:59.235 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:59.235 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:09:48.915147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:59.235 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:09:47.913444+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=9, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=13, tm_sec=33, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:15:59.236 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:16:19.237 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:16:19.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:16:19.615 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-04-26T12:16:19.627 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-26T12:16:18.964241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":702380,"kb_used_data":3476,"kb_used_omap":10,"kb_used_meta":698869,"kb_avail":282413140,"statfs":{"total":289910292480,"available":289191055360,"internally_reserved":0,"allocated":3559424,"data_stored":2095743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10291,"internal_metadata":715642829},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003017"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.042769+0000","last_change":"2024-04-26T12:13:40.895460+0000","last_active":"2024-04-26T12:14:02.042769+0000","last_peered":"2024-04-26T12:14:02.042769+0000","last_clean":"2024-04-26T12:14:02.042769+0000","last_became_active":"2024-04-26T12:09:49.371247+0000","last_became_peered":"2024-04-26T12:09:49.371247+0000","last_unstale":"2024-04-26T12:14:02.042769+0000","last_undegraded":"2024-04-26T12:14:02.042769+0000","last_fullsized":"2024-04-26T12:14:02.042769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.895295+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.895295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:40.769514+0000","scrub_duration":0.079014600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:22.990086+0000","last_change":"2024-04-26T12:15:22.990086+0000","last_active":"2024-04-26T12:15:22.990086+0000","last_peered":"2024-04-26T12:15:22.990086+0000","last_clean":"2024-04-26T12:15:22.990086+0000","last_became_active":"2024-04-26T12:09:49.378597+0000","last_became_peered":"2024-04-26T12:09:49.378597+0000","last_unstale":"2024-04-26T12:15:22.990086+0000","last_undegraded":"2024-04-26T12:15:22.990086+0000","last_fullsized":"2024-04-26T12:15:22.990086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:22.989949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:22.989949+0000","last_clean_scrub_stamp":"2024-04-26T12:15:22.989949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:23.505337+0000","scrub_duration":0.00186264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.900430+0000","last_change":"2024-04-26T12:13:39.900430+0000","last_active":"2024-04-26T12:13:39.900430+0000","last_peered":"2024-04-26T12:13:39.900430+0000","last_clean":"2024-04-26T12:13:39.900430+0000","last_became_active":"2024-04-26T12:13:14.390817+0000","last_became_peered":"2024-04-26T12:13:14.390817+0000","last_unstale":"2024-04-26T12:13:39.900430+0000","last_undegraded":"2024-04-26T12:13:39.900430+0000","last_fullsized":"2024-04-26T12:13:39.900430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.900306+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.900306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:20.016320+0000","scrub_duration":0.00148522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:30.560988+0000","last_change":"2024-04-26T12:15:30.561091+0000","last_active":"2024-04-26T12:15:30.560988+0000","last_peered":"2024-04-26T12:15:30.560988+0000","last_clean":"2024-04-26T12:15:30.560988+0000","last_became_active":"2024-04-26T12:13:14.388863+0000","last_became_peered":"2024-04-26T12:13:14.388863+0000","last_unstale":"2024-04-26T12:15:30.560988+0000","last_undegraded":"2024-04-26T12:15:30.560988+0000","last_fullsized":"2024-04-26T12:15:30.560988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:30.560966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:30.560966+0000","last_clean_scrub_stamp":"2024-04-26T12:15:30.560966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:24.644207+0000","scrub_duration":0.001942626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.957122+0000","last_change":"2024-04-26T12:14:21.957122+0000","last_active":"2024-04-26T12:14:21.957122+0000","last_peered":"2024-04-26T12:14:21.957122+0000","last_clean":"2024-04-26T12:14:21.957122+0000","last_became_active":"2024-04-26T12:09:49.371006+0000","last_became_peered":"2024-04-26T12:09:49.371006+0000","last_unstale":"2024-04-26T12:14:21.957122+0000","last_undegraded":"2024-04-26T12:14:21.957122+0000","last_fullsized":"2024-04-26T12:14:21.957122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.956989+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.956989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.739324+0000","scrub_duration":0.017760125000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.857441+0000","last_change":"2024-04-26T12:14:30.857441+0000","last_active":"2024-04-26T12:14:30.857441+0000","last_peered":"2024-04-26T12:14:30.857441+0000","last_clean":"2024-04-26T12:14:30.857441+0000","last_became_active":"2024-04-26T12:13:14.386171+0000","last_became_peered":"2024-04-26T12:13:14.386171+0000","last_unstale":"2024-04-26T12:14:30.857441+0000","last_undegraded":"2024-04-26T12:14:30.857441+0000","last_fullsized":"2024-04-26T12:14:30.857441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.857300+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.857300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:25.197434+0000","scrub_duration":0.0017286269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:14.796458+0000","last_change":"2024-04-26T12:15:14.796458+0000","last_active":"2024-04-26T12:15:14.796458+0000","last_peered":"2024-04-26T12:15:14.796458+0000","last_clean":"2024-04-26T12:15:14.796458+0000","last_became_active":"2024-04-26T12:13:14.386113+0000","last_became_peered":"2024-04-26T12:13:14.386113+0000","last_unstale":"2024-04-26T12:15:14.796458+0000","last_undegraded":"2024-04-26T12:15:14.796458+0000","last_fullsized":"2024-04-26T12:15:14.796458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:14.796316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:14.796316+0000","last_clean_scrub_stamp":"2024-04-26T12:15:14.796316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:39.641302+0000","scrub_duration":0.018361062000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:13.784060+0000","last_change":"2024-04-26T12:15:13.784060+0000","last_active":"2024-04-26T12:15:13.784060+0000","last_peered":"2024-04-26T12:15:13.784060+0000","last_clean":"2024-04-26T12:15:13.784060+0000","last_became_active":"2024-04-26T12:13:14.386593+0000","last_became_peered":"2024-04-26T12:13:14.386593+0000","last_unstale":"2024-04-26T12:15:13.784060+0000","last_undegraded":"2024-04-26T12:15:13.784060+0000","last_fullsized":"2024-04-26T12:15:13.784060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:13.783914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:13.783914+0000","last_clean_scrub_stamp":"2024-04-26T12:15:13.783914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:51.230549+0000","scrub_duration":0.00186824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.234851+0000","last_change":"2024-04-26T12:15:06.234993+0000","last_active":"2024-04-26T12:15:06.234851+0000","last_peered":"2024-04-26T12:15:06.234851+0000","last_clean":"2024-04-26T12:15:06.234851+0000","last_became_active":"2024-04-26T12:09:49.379925+0000","last_became_peered":"2024-04-26T12:09:49.379925+0000","last_unstale":"2024-04-26T12:15:06.234851+0000","last_undegraded":"2024-04-26T12:15:06.234851+0000","last_fullsized":"2024-04-26T12:15:06.234851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.234824+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.234824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:39.262367+0000","scrub_duration":0.03054697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:27.017214+0000","last_change":"2024-04-26T12:14:27.017214+0000","last_active":"2024-04-26T12:14:27.017214+0000","last_peered":"2024-04-26T12:14:27.017214+0000","last_clean":"2024-04-26T12:14:27.017214+0000","last_became_active":"2024-04-26T12:09:49.371923+0000","last_became_peered":"2024-04-26T12:09:49.371923+0000","last_unstale":"2024-04-26T12:14:27.017214+0000","last_undegraded":"2024-04-26T12:14:27.017214+0000","last_fullsized":"2024-04-26T12:14:27.017214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:27.017091+0000","last_clean_scrub_stamp":"2024-04-26T12:14:27.017091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:37.663928+0000","scrub_duration":0.001639759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:29.611444+0000","last_change":"2024-04-26T12:15:29.611444+0000","last_active":"2024-04-26T12:15:29.611444+0000","last_peered":"2024-04-26T12:15:29.611444+0000","last_clean":"2024-04-26T12:15:29.611444+0000","last_became_active":"2024-04-26T12:13:14.391828+0000","last_became_peered":"2024-04-26T12:13:14.391828+0000","last_unstale":"2024-04-26T12:15:29.611444+0000","last_undegraded":"2024-04-26T12:15:29.611444+0000","last_fullsized":"2024-04-26T12:15:29.611444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:29.611262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:29.611262+0000","last_clean_scrub_stamp":"2024-04-26T12:15:29.611262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:58.849517+0000","scrub_duration":0.017749485999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:17.937988+0000","last_change":"2024-04-26T12:15:17.938118+0000","last_active":"2024-04-26T12:15:17.937988+0000","last_peered":"2024-04-26T12:15:17.937988+0000","last_clean":"2024-04-26T12:15:17.937988+0000","last_became_active":"2024-04-26T12:13:14.394069+0000","last_became_peered":"2024-04-26T12:13:14.394069+0000","last_unstale":"2024-04-26T12:15:17.937988+0000","last_undegraded":"2024-04-26T12:15:17.937988+0000","last_fullsized":"2024-04-26T12:15:17.937988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:17.937964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:17.937964+0000","last_clean_scrub_stamp":"2024-04-26T12:15:17.937964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.759628+0000","scrub_duration":0.0019884460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.768255+0000","last_change":"2024-04-26T12:13:37.768255+0000","last_active":"2024-04-26T12:13:37.768255+0000","last_peered":"2024-04-26T12:13:37.768255+0000","last_clean":"2024-04-26T12:13:37.768255+0000","last_became_active":"2024-04-26T12:09:49.376316+0000","last_became_peered":"2024-04-26T12:09:49.376316+0000","last_unstale":"2024-04-26T12:13:37.768255+0000","last_undegraded":"2024-04-26T12:13:37.768255+0000","last_fullsized":"2024-04-26T12:13:37.768255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.768078+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.768078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:04.695982+0000","scrub_duration":0.017523713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:16:00.461280+0000","last_change":"2024-04-26T12:16:00.461379+0000","last_active":"2024-04-26T12:16:00.461280+0000","last_peered":"2024-04-26T12:16:00.461280+0000","last_clean":"2024-04-26T12:16:00.461280+0000","last_became_active":"2024-04-26T12:13:14.389737+0000","last_became_peered":"2024-04-26T12:13:14.389737+0000","last_unstale":"2024-04-26T12:16:00.461280+0000","last_undegraded":"2024-04-26T12:16:00.461280+0000","last_fullsized":"2024-04-26T12:16:00.461280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:16:00.461256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:16:00.461256+0000","last_clean_scrub_stamp":"2024-04-26T12:16:00.461256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:14.209185+0000","scrub_duration":0.0017586730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:42.491223+0000","last_change":"2024-04-26T12:15:42.491358+0000","last_active":"2024-04-26T12:15:42.491223+0000","last_peered":"2024-04-26T12:15:42.491223+0000","last_clean":"2024-04-26T12:15:42.491223+0000","last_became_active":"2024-04-26T12:13:14.390569+0000","last_became_peered":"2024-04-26T12:13:14.390569+0000","last_unstale":"2024-04-26T12:15:42.491223+0000","last_undegraded":"2024-04-26T12:15:42.491223+0000","last_fullsized":"2024-04-26T12:15:42.491223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:42.491196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:42.491196+0000","last_clean_scrub_stamp":"2024-04-26T12:15:42.491196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:25.432195+0000","scrub_duration":0.001712699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:16.737298+0000","last_change":"2024-04-26T12:15:16.737298+0000","last_active":"2024-04-26T12:15:16.737298+0000","last_peered":"2024-04-26T12:15:16.737298+0000","last_clean":"2024-04-26T12:15:16.737298+0000","last_became_active":"2024-04-26T12:13:14.385891+0000","last_became_peered":"2024-04-26T12:13:14.385891+0000","last_unstale":"2024-04-26T12:15:16.737298+0000","last_undegraded":"2024-04-26T12:15:16.737298+0000","last_fullsized":"2024-04-26T12:15:16.737298+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:16.737138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:16.737138+0000","last_clean_scrub_stamp":"2024-04-26T12:15:16.737138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:23.146620+0000","scrub_duration":0.001865359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:04.332453+0000","last_change":"2024-04-26T12:15:04.332686+0000","last_active":"2024-04-26T12:15:04.332453+0000","last_peered":"2024-04-26T12:15:04.332453+0000","last_clean":"2024-04-26T12:15:04.332453+0000","last_became_active":"2024-04-26T12:09:49.380013+0000","last_became_peered":"2024-04-26T12:09:49.380013+0000","last_unstale":"2024-04-26T12:15:04.332453+0000","last_undegraded":"2024-04-26T12:15:04.332453+0000","last_fullsized":"2024-04-26T12:15:04.332453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:04.332430+0000","last_clean_scrub_stamp":"2024-04-26T12:15:04.332430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:30.932618+0000","scrub_duration":0.085013177999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:07.011617+0000","last_change":"2024-04-26T12:15:07.011766+0000","last_active":"2024-04-26T12:15:07.011617+0000","last_peered":"2024-04-26T12:15:07.011617+0000","last_clean":"2024-04-26T12:15:07.011617+0000","last_became_active":"2024-04-26T12:09:49.373484+0000","last_became_peered":"2024-04-26T12:09:49.373484+0000","last_unstale":"2024-04-26T12:15:07.011617+0000","last_undegraded":"2024-04-26T12:15:07.011617+0000","last_fullsized":"2024-04-26T12:15:07.011617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:07.011593+0000","last_clean_scrub_stamp":"2024-04-26T12:15:07.011593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:28.154774+0000","scrub_duration":0.0018777920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:13.303269+0000","last_change":"2024-04-26T12:14:13.303269+0000","last_active":"2024-04-26T12:14:13.303269+0000","last_peered":"2024-04-26T12:14:13.303269+0000","last_clean":"2024-04-26T12:14:13.303269+0000","last_became_active":"2024-04-26T12:09:49.378717+0000","last_became_peered":"2024-04-26T12:09:49.378717+0000","last_unstale":"2024-04-26T12:14:13.303269+0000","last_undegraded":"2024-04-26T12:14:13.303269+0000","last_fullsized":"2024-04-26T12:14:13.303269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:13.303081+0000","last_clean_scrub_stamp":"2024-04-26T12:14:13.303081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:22.143477+0000","scrub_duration":0.030270521000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.939043+0000","last_change":"2024-04-26T12:14:06.939043+0000","last_active":"2024-04-26T12:14:06.939043+0000","last_peered":"2024-04-26T12:14:06.939043+0000","last_clean":"2024-04-26T12:14:06.939043+0000","last_became_active":"2024-04-26T12:13:14.392077+0000","last_became_peered":"2024-04-26T12:13:14.392077+0000","last_unstale":"2024-04-26T12:14:06.939043+0000","last_undegraded":"2024-04-26T12:14:06.939043+0000","last_fullsized":"2024-04-26T12:14:06.939043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.938886+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.938886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:15.582389+0000","scrub_duration":0.001685761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:24.762804+0000","last_change":"2024-04-26T12:15:24.762804+0000","last_active":"2024-04-26T12:15:24.762804+0000","last_peered":"2024-04-26T12:15:24.762804+0000","last_clean":"2024-04-26T12:15:24.762804+0000","last_became_active":"2024-04-26T12:13:14.386339+0000","last_became_peered":"2024-04-26T12:13:14.386339+0000","last_unstale":"2024-04-26T12:15:24.762804+0000","last_undegraded":"2024-04-26T12:15:24.762804+0000","last_fullsized":"2024-04-26T12:15:24.762804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:24.762636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:24.762636+0000","last_clean_scrub_stamp":"2024-04-26T12:15:24.762636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:38.325160+0000","scrub_duration":0.026021782,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.945792+0000","last_change":"2024-04-26T12:13:55.945792+0000","last_active":"2024-04-26T12:13:55.945792+0000","last_peered":"2024-04-26T12:13:55.945792+0000","last_clean":"2024-04-26T12:13:55.945792+0000","last_became_active":"2024-04-26T12:13:14.392862+0000","last_became_peered":"2024-04-26T12:13:14.392862+0000","last_unstale":"2024-04-26T12:13:55.945792+0000","last_undegraded":"2024-04-26T12:13:55.945792+0000","last_fullsized":"2024-04-26T12:13:55.945792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.945627+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.945627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:37.317445+0000","scrub_duration":0.0018491639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.353952+0000","last_change":"2024-04-26T12:14:56.354059+0000","last_active":"2024-04-26T12:14:56.353952+0000","last_peered":"2024-04-26T12:14:56.353952+0000","last_clean":"2024-04-26T12:14:56.353952+0000","last_became_active":"2024-04-26T12:13:14.391218+0000","last_became_peered":"2024-04-26T12:13:14.391218+0000","last_unstale":"2024-04-26T12:14:56.353952+0000","last_undegraded":"2024-04-26T12:14:56.353952+0000","last_fullsized":"2024-04-26T12:14:56.353952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.353928+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.353928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:28.867805+0000","scrub_duration":0.0017401999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:03.989617+0000","last_change":"2024-04-26T12:14:03.989617+0000","last_active":"2024-04-26T12:14:03.989617+0000","last_peered":"2024-04-26T12:14:03.989617+0000","last_clean":"2024-04-26T12:14:03.989617+0000","last_became_active":"2024-04-26T12:09:49.371129+0000","last_became_peered":"2024-04-26T12:09:49.371129+0000","last_unstale":"2024-04-26T12:14:03.989617+0000","last_undegraded":"2024-04-26T12:14:03.989617+0000","last_fullsized":"2024-04-26T12:14:03.989617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:03.989464+0000","last_clean_scrub_stamp":"2024-04-26T12:14:03.989464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:03.856745+0000","scrub_duration":0.0021048799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.028305+0000","last_change":"2024-04-26T12:14:06.028305+0000","last_active":"2024-04-26T12:14:06.028305+0000","last_peered":"2024-04-26T12:14:06.028305+0000","last_clean":"2024-04-26T12:14:06.028305+0000","last_became_active":"2024-04-26T12:13:14.394535+0000","last_became_peered":"2024-04-26T12:13:14.394535+0000","last_unstale":"2024-04-26T12:14:06.028305+0000","last_undegraded":"2024-04-26T12:14:06.028305+0000","last_fullsized":"2024-04-26T12:14:06.028305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.028145+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.028145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.528467+0000","scrub_duration":0.030881127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:02.259695+0000","last_change":"2024-04-26T12:15:02.259805+0000","last_active":"2024-04-26T12:15:02.259695+0000","last_peered":"2024-04-26T12:15:02.259695+0000","last_clean":"2024-04-26T12:15:02.259695+0000","last_became_active":"2024-04-26T12:13:14.391527+0000","last_became_peered":"2024-04-26T12:13:14.391527+0000","last_unstale":"2024-04-26T12:15:02.259695+0000","last_undegraded":"2024-04-26T12:15:02.259695+0000","last_fullsized":"2024-04-26T12:15:02.259695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:02.259669+0000","last_clean_scrub_stamp":"2024-04-26T12:15:02.259669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:17.697891+0000","scrub_duration":0.0016369970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:16:08.535250+0000","last_change":"2024-04-26T12:16:08.535397+0000","last_active":"2024-04-26T12:16:08.535250+0000","last_peered":"2024-04-26T12:16:08.535250+0000","last_clean":"2024-04-26T12:16:08.535250+0000","last_became_active":"2024-04-26T12:13:14.392125+0000","last_became_peered":"2024-04-26T12:13:14.392125+0000","last_unstale":"2024-04-26T12:16:08.535250+0000","last_undegraded":"2024-04-26T12:16:08.535250+0000","last_fullsized":"2024-04-26T12:16:08.535250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:16:08.535214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:16:08.535214+0000","last_clean_scrub_stamp":"2024-04-26T12:16:08.535214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:40.645764+0000","scrub_duration":0.0018598060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.065209+0000","last_change":"2024-04-26T12:14:57.065316+0000","last_active":"2024-04-26T12:14:57.065209+0000","last_peered":"2024-04-26T12:14:57.065209+0000","last_clean":"2024-04-26T12:14:57.065209+0000","last_became_active":"2024-04-26T12:09:48.930951+0000","last_became_peered":"2024-04-26T12:09:48.930951+0000","last_unstale":"2024-04-26T12:14:57.065209+0000","last_undegraded":"2024-04-26T12:14:57.065209+0000","last_fullsized":"2024-04-26T12:14:57.065209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:57.065182+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.065182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:20:12.857856+0000","scrub_duration":0.001780539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:54.963249+0000","last_change":"2024-04-26T12:13:54.963249+0000","last_active":"2024-04-26T12:13:54.963249+0000","last_peered":"2024-04-26T12:13:54.963249+0000","last_clean":"2024-04-26T12:13:54.963249+0000","last_became_active":"2024-04-26T12:13:14.397219+0000","last_became_peered":"2024-04-26T12:13:14.397219+0000","last_unstale":"2024-04-26T12:13:54.963249+0000","last_undegraded":"2024-04-26T12:13:54.963249+0000","last_fullsized":"2024-04-26T12:13:54.963249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:54.963081+0000","last_clean_scrub_stamp":"2024-04-26T12:13:54.963081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:19.832283+0000","scrub_duration":0.001626679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:56.384596+0000","last_change":"2024-04-26T12:13:56.384596+0000","last_active":"2024-04-26T12:13:56.384596+0000","last_peered":"2024-04-26T12:13:56.384596+0000","last_clean":"2024-04-26T12:13:56.384596+0000","last_became_active":"2024-04-26T12:13:14.390678+0000","last_became_peered":"2024-04-26T12:13:14.390678+0000","last_unstale":"2024-04-26T12:13:56.384596+0000","last_undegraded":"2024-04-26T12:13:56.384596+0000","last_fullsized":"2024-04-26T12:13:56.384596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:56.384470+0000","last_clean_scrub_stamp":"2024-04-26T12:13:56.384470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:21.161817+0000","scrub_duration":0.001626216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.342633+0000","last_change":"2024-04-26T12:14:55.342633+0000","last_active":"2024-04-26T12:14:55.342633+0000","last_peered":"2024-04-26T12:14:55.342633+0000","last_clean":"2024-04-26T12:14:55.342633+0000","last_became_active":"2024-04-26T12:13:14.391552+0000","last_became_peered":"2024-04-26T12:13:14.391552+0000","last_unstale":"2024-04-26T12:14:55.342633+0000","last_undegraded":"2024-04-26T12:14:55.342633+0000","last_fullsized":"2024-04-26T12:14:55.342633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.342504+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.342504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.330593+0000","scrub_duration":0.001697816,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:06.345322+0000","last_change":"2024-04-26T12:14:06.345322+0000","last_active":"2024-04-26T12:14:06.345322+0000","last_peered":"2024-04-26T12:14:06.345322+0000","last_clean":"2024-04-26T12:14:06.345322+0000","last_became_active":"2024-04-26T12:09:48.930510+0000","last_became_peered":"2024-04-26T12:09:48.930510+0000","last_unstale":"2024-04-26T12:14:06.345322+0000","last_undegraded":"2024-04-26T12:14:06.345322+0000","last_fullsized":"2024-04-26T12:14:06.345322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:06.345163+0000","last_clean_scrub_stamp":"2024-04-26T12:14:06.345163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:06.212444+0000","scrub_duration":0.002230793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.042753+0000","last_change":"2024-04-26T12:13:46.973075+0000","last_active":"2024-04-26T12:14:02.042753+0000","last_peered":"2024-04-26T12:14:02.042753+0000","last_clean":"2024-04-26T12:14:02.042753+0000","last_became_active":"2024-04-26T12:13:14.393532+0000","last_became_peered":"2024-04-26T12:13:14.393532+0000","last_unstale":"2024-04-26T12:14:02.042753+0000","last_undegraded":"2024-04-26T12:14:02.042753+0000","last_fullsized":"2024-04-26T12:14:02.042753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.972908+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.972908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:21.462773+0000","scrub_duration":0.065580978999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:15.275693+0000","last_change":"2024-04-26T12:14:15.275693+0000","last_active":"2024-04-26T12:14:15.275693+0000","last_peered":"2024-04-26T12:14:15.275693+0000","last_clean":"2024-04-26T12:14:15.275693+0000","last_became_active":"2024-04-26T12:13:14.391005+0000","last_became_peered":"2024-04-26T12:13:14.391005+0000","last_unstale":"2024-04-26T12:14:15.275693+0000","last_undegraded":"2024-04-26T12:14:15.275693+0000","last_fullsized":"2024-04-26T12:14:15.275693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:15.275528+0000","last_clean_scrub_stamp":"2024-04-26T12:14:15.275528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:03.816301+0000","scrub_duration":0.0017978549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:40.448534+0000","last_change":"2024-04-26T12:13:40.448534+0000","last_active":"2024-04-26T12:13:40.448534+0000","last_peered":"2024-04-26T12:13:40.448534+0000","last_clean":"2024-04-26T12:13:40.448534+0000","last_became_active":"2024-04-26T12:09:49.378173+0000","last_became_peered":"2024-04-26T12:09:49.378173+0000","last_unstale":"2024-04-26T12:13:40.448534+0000","last_undegraded":"2024-04-26T12:13:40.448534+0000","last_fullsized":"2024-04-26T12:13:40.448534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:40.448407+0000","last_clean_scrub_stamp":"2024-04-26T12:13:40.448407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:31.921964+0000","scrub_duration":0.0015444879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.969053+0000","last_change":"2024-04-26T12:14:08.969053+0000","last_active":"2024-04-26T12:14:08.969053+0000","last_peered":"2024-04-26T12:14:08.969053+0000","last_clean":"2024-04-26T12:14:08.969053+0000","last_became_active":"2024-04-26T12:13:14.388756+0000","last_became_peered":"2024-04-26T12:13:14.388756+0000","last_unstale":"2024-04-26T12:14:08.969053+0000","last_undegraded":"2024-04-26T12:14:08.969053+0000","last_fullsized":"2024-04-26T12:14:08.969053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.968921+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.968921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:25.227979+0000","scrub_duration":0.0015995899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.429010+0000","last_change":"2024-04-26T12:13:55.429010+0000","last_active":"2024-04-26T12:13:55.429010+0000","last_peered":"2024-04-26T12:13:55.429010+0000","last_clean":"2024-04-26T12:13:55.429010+0000","last_became_active":"2024-04-26T12:13:14.390440+0000","last_became_peered":"2024-04-26T12:13:14.390440+0000","last_unstale":"2024-04-26T12:13:55.429010+0000","last_undegraded":"2024-04-26T12:13:55.429010+0000","last_fullsized":"2024-04-26T12:13:55.429010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.428868+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.428868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:41.063831+0000","scrub_duration":0.001834004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'5","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:05.050139+0000","last_change":"2024-04-26T12:15:05.050238+0000","last_active":"2024-04-26T12:15:05.050139+0000","last_peered":"2024-04-26T12:15:05.050139+0000","last_clean":"2024-04-26T12:15:05.050139+0000","last_became_active":"2024-04-26T12:13:14.394441+0000","last_became_peered":"2024-04-26T12:13:14.394441+0000","last_unstale":"2024-04-26T12:15:05.050139+0000","last_undegraded":"2024-04-26T12:15:05.050139+0000","last_fullsized":"2024-04-26T12:15:05.050139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'5","last_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_deep_scrub":"71'5","last_deep_scrub_stamp":"2024-04-26T12:15:05.050114+0000","last_clean_scrub_stamp":"2024-04-26T12:15:05.050114+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.650303+0000","scrub_duration":0.0036686359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:38.448329+0000","last_change":"2024-04-26T12:13:38.448329+0000","last_active":"2024-04-26T12:13:38.448329+0000","last_peered":"2024-04-26T12:13:38.448329+0000","last_clean":"2024-04-26T12:13:38.448329+0000","last_became_active":"2024-04-26T12:09:49.378691+0000","last_became_peered":"2024-04-26T12:09:49.378691+0000","last_unstale":"2024-04-26T12:13:38.448329+0000","last_undegraded":"2024-04-26T12:13:38.448329+0000","last_fullsized":"2024-04-26T12:13:38.448329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:38.448201+0000","last_clean_scrub_stamp":"2024-04-26T12:13:38.448201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:05.376106+0000","scrub_duration":0.0018286260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"71'10","reported_seq":48,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:49.478185+0000","last_change":"2024-04-26T12:15:49.478281+0000","last_active":"2024-04-26T12:15:49.478185+0000","last_peered":"2024-04-26T12:15:49.478185+0000","last_clean":"2024-04-26T12:15:49.478185+0000","last_became_active":"2024-04-26T12:13:14.389807+0000","last_became_peered":"2024-04-26T12:13:14.389807+0000","last_unstale":"2024-04-26T12:15:49.478185+0000","last_undegraded":"2024-04-26T12:15:49.478185+0000","last_fullsized":"2024-04-26T12:15:49.478185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-04-26T12:15:49.478158+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-04-26T12:15:49.478158+0000","last_clean_scrub_stamp":"2024-04-26T12:15:49.478158+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:51.973560+0000","scrub_duration":0.0043457770000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:16:02.450330+0000","last_change":"2024-04-26T12:16:02.450440+0000","last_active":"2024-04-26T12:16:02.450330+0000","last_peered":"2024-04-26T12:16:02.450330+0000","last_clean":"2024-04-26T12:16:02.450330+0000","last_became_active":"2024-04-26T12:13:14.393108+0000","last_became_peered":"2024-04-26T12:13:14.393108+0000","last_unstale":"2024-04-26T12:16:02.450330+0000","last_undegraded":"2024-04-26T12:16:02.450330+0000","last_fullsized":"2024-04-26T12:16:02.450330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:16:02.450305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:16:02.450305+0000","last_clean_scrub_stamp":"2024-04-26T12:16:02.450305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.123028+0000","scrub_duration":0.001978016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'4","reported_seq":41,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:33.842822+0000","last_change":"2024-04-26T12:14:33.842822+0000","last_active":"2024-04-26T12:14:33.842822+0000","last_peered":"2024-04-26T12:14:33.842822+0000","last_clean":"2024-04-26T12:14:33.842822+0000","last_became_active":"2024-04-26T12:13:14.392143+0000","last_became_peered":"2024-04-26T12:13:14.392143+0000","last_unstale":"2024-04-26T12:14:33.842822+0000","last_undegraded":"2024-04-26T12:14:33.842822+0000","last_fullsized":"2024-04-26T12:14:33.842822+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-04-26T12:14:33.842693+0000","last_clean_scrub_stamp":"2024-04-26T12:14:33.842693+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:46.697373+0000","scrub_duration":0.0037628990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:43.863656+0000","last_change":"2024-04-26T12:13:43.863656+0000","last_active":"2024-04-26T12:13:43.863656+0000","last_peered":"2024-04-26T12:13:43.863656+0000","last_clean":"2024-04-26T12:13:43.863656+0000","last_became_active":"2024-04-26T12:09:49.375436+0000","last_became_peered":"2024-04-26T12:09:49.375436+0000","last_unstale":"2024-04-26T12:13:43.863656+0000","last_undegraded":"2024-04-26T12:13:43.863656+0000","last_fullsized":"2024-04-26T12:13:43.863656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:43.863535+0000","last_clean_scrub_stamp":"2024-04-26T12:13:43.863535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:22.233293+0000","scrub_duration":0.001581467,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.368067+0000","last_change":"2024-04-26T12:14:35.368170+0000","last_active":"2024-04-26T12:14:35.368067+0000","last_peered":"2024-04-26T12:14:35.368067+0000","last_clean":"2024-04-26T12:14:35.368067+0000","last_became_active":"2024-04-26T12:13:14.387849+0000","last_became_peered":"2024-04-26T12:13:14.387849+0000","last_unstale":"2024-04-26T12:14:35.368067+0000","last_undegraded":"2024-04-26T12:14:35.368067+0000","last_fullsized":"2024-04-26T12:14:35.368067+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.368043+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.368043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:47.502525+0000","scrub_duration":0.001810372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:45.916478+0000","last_change":"2024-04-26T12:13:45.916478+0000","last_active":"2024-04-26T12:13:45.916478+0000","last_peered":"2024-04-26T12:13:45.916478+0000","last_clean":"2024-04-26T12:13:45.916478+0000","last_became_active":"2024-04-26T12:09:49.371226+0000","last_became_peered":"2024-04-26T12:09:49.371226+0000","last_unstale":"2024-04-26T12:13:45.916478+0000","last_undegraded":"2024-04-26T12:13:45.916478+0000","last_fullsized":"2024-04-26T12:13:45.916478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:45.916348+0000","last_clean_scrub_stamp":"2024-04-26T12:13:45.916348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:36.869216+0000","scrub_duration":0.018497474999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:11.994111+0000","last_change":"2024-04-26T12:14:11.994111+0000","last_active":"2024-04-26T12:14:11.994111+0000","last_peered":"2024-04-26T12:14:11.994111+0000","last_clean":"2024-04-26T12:14:11.994111+0000","last_became_active":"2024-04-26T12:13:14.392809+0000","last_became_peered":"2024-04-26T12:13:14.392809+0000","last_unstale":"2024-04-26T12:14:11.994111+0000","last_undegraded":"2024-04-26T12:14:11.994111+0000","last_fullsized":"2024-04-26T12:14:11.994111+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:11.993982+0000","last_clean_scrub_stamp":"2024-04-26T12:14:11.993982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:32.318691+0000","scrub_duration":0.0019965569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:46.433336+0000","last_change":"2024-04-26T12:13:46.433336+0000","last_active":"2024-04-26T12:13:46.433336+0000","last_peered":"2024-04-26T12:13:46.433336+0000","last_clean":"2024-04-26T12:13:46.433336+0000","last_became_active":"2024-04-26T12:13:14.392046+0000","last_became_peered":"2024-04-26T12:13:14.392046+0000","last_unstale":"2024-04-26T12:13:46.433336+0000","last_undegraded":"2024-04-26T12:13:46.433336+0000","last_fullsized":"2024-04-26T12:13:46.433336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:46.433208+0000","last_clean_scrub_stamp":"2024-04-26T12:13:46.433208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.495620+0000","scrub_duration":0.0020046320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'12","reported_seq":47,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.841922+0000","last_change":"2024-04-26T12:14:18.841922+0000","last_active":"2024-04-26T12:14:18.841922+0000","last_peered":"2024-04-26T12:14:18.841922+0000","last_clean":"2024-04-26T12:14:18.841922+0000","last_became_active":"2024-04-26T12:13:14.387707+0000","last_became_peered":"2024-04-26T12:13:14.387707+0000","last_unstale":"2024-04-26T12:14:18.841922+0000","last_undegraded":"2024-04-26T12:14:18.841922+0000","last_fullsized":"2024-04-26T12:14:18.841922+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-04-26T12:14:18.841792+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.841792+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:13.987239+0000","scrub_duration":0.0044348529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.433157+0000","last_change":"2024-04-26T12:13:48.433157+0000","last_active":"2024-04-26T12:13:48.433157+0000","last_peered":"2024-04-26T12:13:48.433157+0000","last_clean":"2024-04-26T12:13:48.433157+0000","last_became_active":"2024-04-26T12:13:14.396120+0000","last_became_peered":"2024-04-26T12:13:14.396120+0000","last_unstale":"2024-04-26T12:13:48.433157+0000","last_undegraded":"2024-04-26T12:13:48.433157+0000","last_fullsized":"2024-04-26T12:13:48.433157+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.433001+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.433001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:51.272533+0000","scrub_duration":0.045761058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"71'2","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:53.469952+0000","last_change":"2024-04-26T12:15:53.470075+0000","last_active":"2024-04-26T12:15:53.469952+0000","last_peered":"2024-04-26T12:15:53.469952+0000","last_clean":"2024-04-26T12:15:53.469952+0000","last_became_active":"2024-04-26T12:13:14.389973+0000","last_became_peered":"2024-04-26T12:13:14.389973+0000","last_unstale":"2024-04-26T12:15:53.469952+0000","last_undegraded":"2024-04-26T12:15:53.469952+0000","last_fullsized":"2024-04-26T12:15:53.469952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:15:53.469927+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:15:53.469927+0000","last_clean_scrub_stamp":"2024-04-26T12:15:53.469927+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:32.131461+0000","scrub_duration":0.0032387370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:13.928108+0000","last_change":"2024-04-26T12:15:13.928200+0000","last_active":"2024-04-26T12:15:13.928108+0000","last_peered":"2024-04-26T12:15:13.928108+0000","last_clean":"2024-04-26T12:15:13.928108+0000","last_became_active":"2024-04-26T12:13:14.393055+0000","last_became_peered":"2024-04-26T12:13:14.393055+0000","last_unstale":"2024-04-26T12:15:13.928108+0000","last_undegraded":"2024-04-26T12:15:13.928108+0000","last_fullsized":"2024-04-26T12:15:13.928108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:13.928083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:13.928083+0000","last_clean_scrub_stamp":"2024-04-26T12:15:13.928083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:45.700894+0000","scrub_duration":0.0017930660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.959426+0000","last_change":"2024-04-26T12:14:22.959531+0000","last_active":"2024-04-26T12:14:22.959426+0000","last_peered":"2024-04-26T12:14:22.959426+0000","last_clean":"2024-04-26T12:14:22.959426+0000","last_became_active":"2024-04-26T12:13:14.392613+0000","last_became_peered":"2024-04-26T12:13:14.392613+0000","last_unstale":"2024-04-26T12:14:22.959426+0000","last_undegraded":"2024-04-26T12:14:22.959426+0000","last_fullsized":"2024-04-26T12:14:22.959426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.959400+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.959400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.893413+0000","scrub_duration":0.0031299650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:10.948171+0000","last_change":"2024-04-26T12:15:10.948276+0000","last_active":"2024-04-26T12:15:10.948171+0000","last_peered":"2024-04-26T12:15:10.948171+0000","last_clean":"2024-04-26T12:15:10.948171+0000","last_became_active":"2024-04-26T12:09:49.371059+0000","last_became_peered":"2024-04-26T12:09:49.371059+0000","last_unstale":"2024-04-26T12:15:10.948171+0000","last_undegraded":"2024-04-26T12:15:10.948171+0000","last_fullsized":"2024-04-26T12:15:10.948171+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:10.948146+0000","last_clean_scrub_stamp":"2024-04-26T12:15:10.948146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:24.938423+0000","scrub_duration":0.001742684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'2","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.903851+0000","last_change":"2024-04-26T12:14:12.903851+0000","last_active":"2024-04-26T12:14:12.903851+0000","last_peered":"2024-04-26T12:14:12.903851+0000","last_clean":"2024-04-26T12:14:12.903851+0000","last_became_active":"2024-04-26T12:13:14.388535+0000","last_became_peered":"2024-04-26T12:13:14.388535+0000","last_unstale":"2024-04-26T12:14:12.903851+0000","last_undegraded":"2024-04-26T12:14:12.903851+0000","last_fullsized":"2024-04-26T12:14:12.903851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:12.903685+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.903685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:26.642032+0000","scrub_duration":0.0032440770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:47.879159+0000","last_change":"2024-04-26T12:13:47.879159+0000","last_active":"2024-04-26T12:13:47.879159+0000","last_peered":"2024-04-26T12:13:47.879159+0000","last_clean":"2024-04-26T12:13:47.879159+0000","last_became_active":"2024-04-26T12:13:14.391008+0000","last_became_peered":"2024-04-26T12:13:14.391008+0000","last_unstale":"2024-04-26T12:13:47.879159+0000","last_undegraded":"2024-04-26T12:13:47.879159+0000","last_fullsized":"2024-04-26T12:13:47.879159+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.879023+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.879023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:55.268992+0000","scrub_duration":0.00195049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:16:05.442551+0000","last_change":"2024-04-26T12:16:05.442660+0000","last_active":"2024-04-26T12:16:05.442551+0000","last_peered":"2024-04-26T12:16:05.442551+0000","last_clean":"2024-04-26T12:16:05.442551+0000","last_became_active":"2024-04-26T12:13:14.393000+0000","last_became_peered":"2024-04-26T12:13:14.393000+0000","last_unstale":"2024-04-26T12:16:05.442551+0000","last_undegraded":"2024-04-26T12:16:05.442551+0000","last_fullsized":"2024-04-26T12:16:05.442551+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:16:05.442523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:16:05.442523+0000","last_clean_scrub_stamp":"2024-04-26T12:16:05.442523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:30.541906+0000","scrub_duration":0.001895765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:39.481077+0000","last_change":"2024-04-26T12:13:39.481077+0000","last_active":"2024-04-26T12:13:39.481077+0000","last_peered":"2024-04-26T12:13:39.481077+0000","last_clean":"2024-04-26T12:13:39.481077+0000","last_became_active":"2024-04-26T12:13:14.396276+0000","last_became_peered":"2024-04-26T12:13:14.396276+0000","last_unstale":"2024-04-26T12:13:39.481077+0000","last_undegraded":"2024-04-26T12:13:39.481077+0000","last_fullsized":"2024-04-26T12:13:39.481077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:39.480900+0000","last_clean_scrub_stamp":"2024-04-26T12:13:39.480900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:34.203720+0000","scrub_duration":0.029576188,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'3","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.339693+0000","last_change":"2024-04-26T12:14:22.339818+0000","last_active":"2024-04-26T12:14:22.339693+0000","last_peered":"2024-04-26T12:14:22.339693+0000","last_clean":"2024-04-26T12:14:22.339693+0000","last_became_active":"2024-04-26T12:13:14.396407+0000","last_became_peered":"2024-04-26T12:13:14.396407+0000","last_unstale":"2024-04-26T12:14:22.339693+0000","last_undegraded":"2024-04-26T12:14:22.339693+0000","last_fullsized":"2024-04-26T12:14:22.339693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.339667+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.339667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.273680+0000","scrub_duration":0.003330211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.889408+0000","last_change":"2024-04-26T12:14:35.889408+0000","last_active":"2024-04-26T12:14:35.889408+0000","last_peered":"2024-04-26T12:14:35.889408+0000","last_clean":"2024-04-26T12:14:35.889408+0000","last_became_active":"2024-04-26T12:13:14.386727+0000","last_became_peered":"2024-04-26T12:13:14.386727+0000","last_unstale":"2024-04-26T12:14:35.889408+0000","last_undegraded":"2024-04-26T12:14:35.889408+0000","last_fullsized":"2024-04-26T12:14:35.889408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.889249+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.889249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.444942+0000","scrub_duration":0.0023221090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:38.537459+0000","last_change":"2024-04-26T12:15:38.537590+0000","last_active":"2024-04-26T12:15:38.537459+0000","last_peered":"2024-04-26T12:15:38.537459+0000","last_clean":"2024-04-26T12:15:38.537459+0000","last_became_active":"2024-04-26T12:13:14.389681+0000","last_became_peered":"2024-04-26T12:13:14.389681+0000","last_unstale":"2024-04-26T12:15:38.537459+0000","last_undegraded":"2024-04-26T12:15:38.537459+0000","last_fullsized":"2024-04-26T12:15:38.537459+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:38.537437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:38.537437+0000","last_clean_scrub_stamp":"2024-04-26T12:15:38.537437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:06:10.933648+0000","scrub_duration":0.0020280469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:37.865071+0000","last_change":"2024-04-26T12:13:37.865071+0000","last_active":"2024-04-26T12:13:37.865071+0000","last_peered":"2024-04-26T12:13:37.865071+0000","last_clean":"2024-04-26T12:13:37.865071+0000","last_became_active":"2024-04-26T12:13:14.392117+0000","last_became_peered":"2024-04-26T12:13:14.392117+0000","last_unstale":"2024-04-26T12:13:37.865071+0000","last_undegraded":"2024-04-26T12:13:37.865071+0000","last_fullsized":"2024-04-26T12:13:37.865071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:37.864935+0000","last_clean_scrub_stamp":"2024-04-26T12:13:37.864935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.909835+0000","scrub_duration":0.0022350709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:01.114069+0000","last_change":"2024-04-26T12:15:01.114240+0000","last_active":"2024-04-26T12:15:01.114069+0000","last_peered":"2024-04-26T12:15:01.114069+0000","last_clean":"2024-04-26T12:15:01.114069+0000","last_became_active":"2024-04-26T12:13:14.392580+0000","last_became_peered":"2024-04-26T12:13:14.392580+0000","last_unstale":"2024-04-26T12:15:01.114069+0000","last_undegraded":"2024-04-26T12:15:01.114069+0000","last_fullsized":"2024-04-26T12:15:01.114069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:01.114045+0000","last_clean_scrub_stamp":"2024-04-26T12:15:01.114045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:29.694980+0000","scrub_duration":0.0020529889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.824242+0000","last_change":"2024-04-26T12:14:28.824242+0000","last_active":"2024-04-26T12:14:28.824242+0000","last_peered":"2024-04-26T12:14:28.824242+0000","last_clean":"2024-04-26T12:14:28.824242+0000","last_became_active":"2024-04-26T12:13:14.389891+0000","last_became_peered":"2024-04-26T12:13:14.389891+0000","last_unstale":"2024-04-26T12:14:28.824242+0000","last_undegraded":"2024-04-26T12:14:28.824242+0000","last_fullsized":"2024-04-26T12:14:28.824242+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.824076+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.824076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:03.088647+0000","scrub_duration":0.001938574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:18.943962+0000","last_change":"2024-04-26T12:14:18.944074+0000","last_active":"2024-04-26T12:14:18.943962+0000","last_peered":"2024-04-26T12:14:18.943962+0000","last_clean":"2024-04-26T12:14:18.943962+0000","last_became_active":"2024-04-26T12:09:48.930777+0000","last_became_peered":"2024-04-26T12:09:48.930777+0000","last_unstale":"2024-04-26T12:14:18.943962+0000","last_undegraded":"2024-04-26T12:14:18.943962+0000","last_fullsized":"2024-04-26T12:14:18.943962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:18.943939+0000","last_clean_scrub_stamp":"2024-04-26T12:14:18.943939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:15.950995+0000","scrub_duration":0.001622535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.435152+0000","last_change":"2024-04-26T12:14:57.435295+0000","last_active":"2024-04-26T12:14:57.435152+0000","last_peered":"2024-04-26T12:14:57.435152+0000","last_clean":"2024-04-26T12:14:57.435152+0000","last_became_active":"2024-04-26T12:09:49.381023+0000","last_became_peered":"2024-04-26T12:09:49.381023+0000","last_unstale":"2024-04-26T12:14:57.435152+0000","last_undegraded":"2024-04-26T12:14:57.435152+0000","last_fullsized":"2024-04-26T12:14:57.435152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:57.435128+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.435128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:29.486293+0000","scrub_duration":0.059299769000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"71'3","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:26.352731+0000","last_change":"2024-04-26T12:14:26.352850+0000","last_active":"2024-04-26T12:14:26.352731+0000","last_peered":"2024-04-26T12:14:26.352731+0000","last_clean":"2024-04-26T12:14:26.352731+0000","last_became_active":"2024-04-26T12:09:48.931955+0000","last_became_peered":"2024-04-26T12:09:48.931955+0000","last_unstale":"2024-04-26T12:14:26.352731+0000","last_undegraded":"2024-04-26T12:14:26.352731+0000","last_fullsized":"2024-04-26T12:14:26.352731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:26.352705+0000","last_clean_scrub_stamp":"2024-04-26T12:14:26.352705+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:36.999542+0000","scrub_duration":0.0032761019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":85,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:35.970590+0000","last_change":"2024-04-26T12:14:35.970590+0000","last_active":"2024-04-26T12:14:35.970590+0000","last_peered":"2024-04-26T12:14:35.970590+0000","last_clean":"2024-04-26T12:14:35.970590+0000","last_became_active":"2024-04-26T12:09:43.906009+0000","last_became_peered":"2024-04-26T12:09:43.906009+0000","last_unstale":"2024-04-26T12:14:35.970590+0000","last_undegraded":"2024-04-26T12:14:35.970590+0000","last_fullsized":"2024-04-26T12:14:35.970590+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:35.970433+0000","last_clean_scrub_stamp":"2024-04-26T12:14:35.970433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:48.104915+0000","scrub_duration":0.0018752809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:08.344901+0000","last_change":"2024-04-26T12:14:08.344901+0000","last_active":"2024-04-26T12:14:08.344901+0000","last_peered":"2024-04-26T12:14:08.344901+0000","last_clean":"2024-04-26T12:14:08.344901+0000","last_became_active":"2024-04-26T12:13:14.391639+0000","last_became_peered":"2024-04-26T12:13:14.391639+0000","last_unstale":"2024-04-26T12:14:08.344901+0000","last_undegraded":"2024-04-26T12:14:08.344901+0000","last_fullsized":"2024-04-26T12:14:08.344901+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:08.344701+0000","last_clean_scrub_stamp":"2024-04-26T12:14:08.344701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:54.999814+0000","scrub_duration":0.0021740610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.943331+0000","last_change":"2024-04-26T12:14:50.943331+0000","last_active":"2024-04-26T12:14:50.943331+0000","last_peered":"2024-04-26T12:14:50.943331+0000","last_clean":"2024-04-26T12:14:50.943331+0000","last_became_active":"2024-04-26T12:13:14.394120+0000","last_became_peered":"2024-04-26T12:13:14.394120+0000","last_unstale":"2024-04-26T12:14:50.943331+0000","last_undegraded":"2024-04-26T12:14:50.943331+0000","last_fullsized":"2024-04-26T12:14:50.943331+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.943190+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.943190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.740367+0000","scrub_duration":0.001687745,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"71'2","reported_seq":95,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.465557+0000","last_change":"2024-04-26T12:14:30.465659+0000","last_active":"2024-04-26T12:14:30.465557+0000","last_peered":"2024-04-26T12:14:30.465557+0000","last_clean":"2024-04-26T12:14:30.465557+0000","last_became_active":"2024-04-26T12:13:14.392031+0000","last_became_peered":"2024-04-26T12:13:14.392031+0000","last_unstale":"2024-04-26T12:14:30.465557+0000","last_undegraded":"2024-04-26T12:14:30.465557+0000","last_fullsized":"2024-04-26T12:14:30.465557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-04-26T12:14:30.465530+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.465530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:48.739313+0000","scrub_duration":0.0032107360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.985450+0000","last_change":"2024-04-26T12:14:02.985450+0000","last_active":"2024-04-26T12:14:02.985450+0000","last_peered":"2024-04-26T12:14:02.985450+0000","last_clean":"2024-04-26T12:14:02.985450+0000","last_became_active":"2024-04-26T12:13:14.391014+0000","last_became_peered":"2024-04-26T12:13:14.391014+0000","last_unstale":"2024-04-26T12:14:02.985450+0000","last_undegraded":"2024-04-26T12:14:02.985450+0000","last_fullsized":"2024-04-26T12:14:02.985450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:02.985282+0000","last_clean_scrub_stamp":"2024-04-26T12:14:02.985282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:00.013031+0000","scrub_duration":0.0019585819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:19.306228+0000","last_change":"2024-04-26T12:14:19.306228+0000","last_active":"2024-04-26T12:14:19.306228+0000","last_peered":"2024-04-26T12:14:19.306228+0000","last_clean":"2024-04-26T12:14:19.306228+0000","last_became_active":"2024-04-26T12:13:14.396638+0000","last_became_peered":"2024-04-26T12:13:14.396638+0000","last_unstale":"2024-04-26T12:14:19.306228+0000","last_undegraded":"2024-04-26T12:14:19.306228+0000","last_fullsized":"2024-04-26T12:14:19.306228+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:19.306105+0000","last_clean_scrub_stamp":"2024-04-26T12:14:19.306105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:15:16.313160+0000","scrub_duration":0.00185067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"71'159","reported_seq":235,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:57.764139+0000","last_change":"2024-04-26T12:13:57.764139+0000","last_active":"2024-04-26T12:13:57.764139+0000","last_peered":"2024-04-26T12:13:57.764139+0000","last_clean":"2024-04-26T12:13:57.764139+0000","last_became_active":"2024-04-26T12:13:14.386600+0000","last_became_peered":"2024-04-26T12:13:14.386600+0000","last_unstale":"2024-04-26T12:13:57.764139+0000","last_undegraded":"2024-04-26T12:13:57.764139+0000","last_fullsized":"2024-04-26T12:13:57.764139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'159","last_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_deep_scrub":"71'159","last_deep_scrub_stamp":"2024-04-26T12:13:57.764010+0000","last_clean_scrub_stamp":"2024-04-26T12:13:57.764010+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:56.287305+0000","scrub_duration":0.0053084050000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:20.285067+0000","last_change":"2024-04-26T12:14:20.285067+0000","last_active":"2024-04-26T12:14:20.285067+0000","last_peered":"2024-04-26T12:14:20.285067+0000","last_clean":"2024-04-26T12:14:20.285067+0000","last_became_active":"2024-04-26T12:13:14.388662+0000","last_became_peered":"2024-04-26T12:13:14.388662+0000","last_unstale":"2024-04-26T12:14:20.285067+0000","last_undegraded":"2024-04-26T12:14:20.285067+0000","last_fullsized":"2024-04-26T12:14:20.285067+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:20.284929+0000","last_clean_scrub_stamp":"2024-04-26T12:14:20.284929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:17.159266+0000","scrub_duration":0.0019985570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:48.933313+0000","last_change":"2024-04-26T12:13:48.933313+0000","last_active":"2024-04-26T12:13:48.933313+0000","last_peered":"2024-04-26T12:13:48.933313+0000","last_clean":"2024-04-26T12:13:48.933313+0000","last_became_active":"2024-04-26T12:09:49.372124+0000","last_became_peered":"2024-04-26T12:09:49.372124+0000","last_unstale":"2024-04-26T12:13:48.933313+0000","last_undegraded":"2024-04-26T12:13:48.933313+0000","last_fullsized":"2024-04-26T12:13:48.933313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:48.933134+0000","last_clean_scrub_stamp":"2024-04-26T12:13:48.933134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:12.666427+0000","scrub_duration":0.0019711759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:53.803474+0000","last_change":"2024-04-26T12:13:53.803474+0000","last_active":"2024-04-26T12:13:53.803474+0000","last_peered":"2024-04-26T12:13:53.803474+0000","last_clean":"2024-04-26T12:13:53.803474+0000","last_became_active":"2024-04-26T12:13:14.387483+0000","last_became_peered":"2024-04-26T12:13:14.387483+0000","last_unstale":"2024-04-26T12:13:53.803474+0000","last_undegraded":"2024-04-26T12:13:53.803474+0000","last_fullsized":"2024-04-26T12:13:53.803474+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.803268+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.803268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.773438+0000","scrub_duration":0.0021962370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:56.079764+0000","last_change":"2024-04-26T12:14:56.079764+0000","last_active":"2024-04-26T12:14:56.079764+0000","last_peered":"2024-04-26T12:14:56.079764+0000","last_clean":"2024-04-26T12:14:56.079764+0000","last_became_active":"2024-04-26T12:13:14.393010+0000","last_became_peered":"2024-04-26T12:13:14.393010+0000","last_unstale":"2024-04-26T12:14:56.079764+0000","last_undegraded":"2024-04-26T12:14:56.079764+0000","last_fullsized":"2024-04-26T12:14:56.079764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:56.079578+0000","last_clean_scrub_stamp":"2024-04-26T12:14:56.079578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:15.852956+0000","scrub_duration":0.0019403910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:50.463778+0000","last_change":"2024-04-26T12:14:50.463905+0000","last_active":"2024-04-26T12:14:50.463778+0000","last_peered":"2024-04-26T12:14:50.463778+0000","last_clean":"2024-04-26T12:14:50.463778+0000","last_became_active":"2024-04-26T12:09:49.382477+0000","last_became_peered":"2024-04-26T12:09:49.382477+0000","last_unstale":"2024-04-26T12:14:50.463778+0000","last_undegraded":"2024-04-26T12:14:50.463778+0000","last_fullsized":"2024-04-26T12:14:50.463778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:50.463714+0000","last_clean_scrub_stamp":"2024-04-26T12:14:50.463714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:55.260891+0000","scrub_duration":0.030635608000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:42.833572+0000","last_change":"2024-04-26T12:13:42.833572+0000","last_active":"2024-04-26T12:13:42.833572+0000","last_peered":"2024-04-26T12:13:42.833572+0000","last_clean":"2024-04-26T12:13:42.833572+0000","last_became_active":"2024-04-26T12:13:14.391785+0000","last_became_peered":"2024-04-26T12:13:14.391785+0000","last_unstale":"2024-04-26T12:13:42.833572+0000","last_undegraded":"2024-04-26T12:13:42.833572+0000","last_fullsized":"2024-04-26T12:13:42.833572+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:42.833425+0000","last_clean_scrub_stamp":"2024-04-26T12:13:42.833425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:09.036432+0000","scrub_duration":0.001992742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:21.332157+0000","last_change":"2024-04-26T12:14:21.332157+0000","last_active":"2024-04-26T12:14:21.332157+0000","last_peered":"2024-04-26T12:14:21.332157+0000","last_clean":"2024-04-26T12:14:21.332157+0000","last_became_active":"2024-04-26T12:09:48.931709+0000","last_became_peered":"2024-04-26T12:09:48.931709+0000","last_unstale":"2024-04-26T12:14:21.332157+0000","last_undegraded":"2024-04-26T12:14:21.332157+0000","last_fullsized":"2024-04-26T12:14:21.332157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:21.332028+0000","last_clean_scrub_stamp":"2024-04-26T12:14:21.332028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:33.114364+0000","scrub_duration":0.001618303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:52.893734+0000","last_change":"2024-04-26T12:14:52.893734+0000","last_active":"2024-04-26T12:14:52.893734+0000","last_peered":"2024-04-26T12:14:52.893734+0000","last_clean":"2024-04-26T12:14:52.893734+0000","last_became_active":"2024-04-26T12:13:14.387610+0000","last_became_peered":"2024-04-26T12:13:14.387610+0000","last_unstale":"2024-04-26T12:14:52.893734+0000","last_undegraded":"2024-04-26T12:14:52.893734+0000","last_fullsized":"2024-04-26T12:14:52.893734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:52.893586+0000","last_clean_scrub_stamp":"2024-04-26T12:14:52.893586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:40.019384+0000","scrub_duration":0.0019374699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:30.983701+0000","last_change":"2024-04-26T12:14:30.983701+0000","last_active":"2024-04-26T12:14:30.983701+0000","last_peered":"2024-04-26T12:14:30.983701+0000","last_clean":"2024-04-26T12:14:30.983701+0000","last_became_active":"2024-04-26T12:09:43.906199+0000","last_became_peered":"2024-04-26T12:09:43.906199+0000","last_unstale":"2024-04-26T12:14:30.983701+0000","last_undegraded":"2024-04-26T12:14:30.983701+0000","last_fullsized":"2024-04-26T12:14:30.983701+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:30.983541+0000","last_clean_scrub_stamp":"2024-04-26T12:14:30.983541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:49.257324+0000","scrub_duration":0.001498107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:40.891919+0000","last_change":"2024-04-26T12:14:40.891919+0000","last_active":"2024-04-26T12:14:40.891919+0000","last_peered":"2024-04-26T12:14:40.891919+0000","last_clean":"2024-04-26T12:14:40.891919+0000","last_became_active":"2024-04-26T12:13:14.392992+0000","last_became_peered":"2024-04-26T12:13:14.392992+0000","last_unstale":"2024-04-26T12:14:40.891919+0000","last_undegraded":"2024-04-26T12:14:40.891919+0000","last_fullsized":"2024-04-26T12:14:40.891919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:40.891766+0000","last_clean_scrub_stamp":"2024-04-26T12:14:40.891766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:11.805668+0000","scrub_duration":0.0015939929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:05.300377+0000","last_change":"2024-04-26T12:14:05.300377+0000","last_active":"2024-04-26T12:14:05.300377+0000","last_peered":"2024-04-26T12:14:05.300377+0000","last_clean":"2024-04-26T12:14:05.300377+0000","last_became_active":"2024-04-26T12:09:49.379896+0000","last_became_peered":"2024-04-26T12:09:49.379896+0000","last_unstale":"2024-04-26T12:14:05.300377+0000","last_undegraded":"2024-04-26T12:14:05.300377+0000","last_fullsized":"2024-04-26T12:14:05.300377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:05.300199+0000","last_clean_scrub_stamp":"2024-04-26T12:14:05.300199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:02.327948+0000","scrub_duration":0.0021145510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":98,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.033468+0000","last_change":"2024-04-26T12:14:55.033468+0000","last_active":"2024-04-26T12:14:55.033468+0000","last_peered":"2024-04-26T12:14:55.033468+0000","last_clean":"2024-04-26T12:14:55.033468+0000","last_became_active":"2024-04-26T12:13:14.391221+0000","last_became_peered":"2024-04-26T12:13:14.391221+0000","last_unstale":"2024-04-26T12:14:55.033468+0000","last_undegraded":"2024-04-26T12:14:55.033468+0000","last_fullsized":"2024-04-26T12:14:55.033468+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.033339+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.033339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.021427+0000","scrub_duration":0.001908943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":81,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.408043+0000","last_change":"2024-04-26T12:14:28.408043+0000","last_active":"2024-04-26T12:14:28.408043+0000","last_peered":"2024-04-26T12:14:28.408043+0000","last_clean":"2024-04-26T12:14:28.408043+0000","last_became_active":"2024-04-26T12:09:48.930989+0000","last_became_peered":"2024-04-26T12:09:48.930989+0000","last_unstale":"2024-04-26T12:14:28.408043+0000","last_undegraded":"2024-04-26T12:14:28.408043+0000","last_fullsized":"2024-04-26T12:14:28.408043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:28.407919+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.407919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.310058+0000","scrub_duration":0.0017962410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.042606+0000","last_change":"2024-04-26T12:13:53.995143+0000","last_active":"2024-04-26T12:14:02.042606+0000","last_peered":"2024-04-26T12:14:02.042606+0000","last_clean":"2024-04-26T12:14:02.042606+0000","last_became_active":"2024-04-26T12:13:14.394272+0000","last_became_peered":"2024-04-26T12:13:14.394272+0000","last_unstale":"2024-04-26T12:14:02.042606+0000","last_undegraded":"2024-04-26T12:14:02.042606+0000","last_fullsized":"2024-04-26T12:14:02.042606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:53.995009+0000","last_clean_scrub_stamp":"2024-04-26T12:13:53.995009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:08.930376+0000","scrub_duration":0.001922558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:41.919576+0000","last_change":"2024-04-26T12:14:41.919576+0000","last_active":"2024-04-26T12:14:41.919576+0000","last_peered":"2024-04-26T12:14:41.919576+0000","last_clean":"2024-04-26T12:14:41.919576+0000","last_became_active":"2024-04-26T12:13:14.388938+0000","last_became_peered":"2024-04-26T12:13:14.388938+0000","last_unstale":"2024-04-26T12:14:41.919576+0000","last_undegraded":"2024-04-26T12:14:41.919576+0000","last_fullsized":"2024-04-26T12:14:41.919576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:41.919408+0000","last_clean_scrub_stamp":"2024-04-26T12:14:41.919408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:23.254496+0000","scrub_duration":0.002109872,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:37.489062+0000","last_change":"2024-04-26T12:15:37.489165+0000","last_active":"2024-04-26T12:15:37.489062+0000","last_peered":"2024-04-26T12:15:37.489062+0000","last_clean":"2024-04-26T12:15:37.489062+0000","last_became_active":"2024-04-26T12:13:14.389933+0000","last_became_peered":"2024-04-26T12:13:14.389933+0000","last_unstale":"2024-04-26T12:15:37.489062+0000","last_undegraded":"2024-04-26T12:15:37.489062+0000","last_fullsized":"2024-04-26T12:15:37.489062+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:37.489039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:37.489039+0000","last_clean_scrub_stamp":"2024-04-26T12:15:37.489039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:50.510957+0000","scrub_duration":0.0018591510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:06.045313+0000","last_change":"2024-04-26T12:15:06.045313+0000","last_active":"2024-04-26T12:15:06.045313+0000","last_peered":"2024-04-26T12:15:06.045313+0000","last_clean":"2024-04-26T12:15:06.045313+0000","last_became_active":"2024-04-26T12:13:14.393893+0000","last_became_peered":"2024-04-26T12:13:14.393893+0000","last_unstale":"2024-04-26T12:15:06.045313+0000","last_undegraded":"2024-04-26T12:15:06.045313+0000","last_fullsized":"2024-04-26T12:15:06.045313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:06.045180+0000","last_clean_scrub_stamp":"2024-04-26T12:15:06.045180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:39.022762+0000","scrub_duration":0.001527748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:28.987377+0000","last_change":"2024-04-26T12:14:28.987377+0000","last_active":"2024-04-26T12:14:28.987377+0000","last_peered":"2024-04-26T12:14:28.987377+0000","last_clean":"2024-04-26T12:14:28.987377+0000","last_became_active":"2024-04-26T12:13:14.397203+0000","last_became_peered":"2024-04-26T12:13:14.397203+0000","last_unstale":"2024-04-26T12:14:28.987377+0000","last_undegraded":"2024-04-26T12:14:28.987377+0000","last_fullsized":"2024-04-26T12:14:28.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:28.987230+0000","last_clean_scrub_stamp":"2024-04-26T12:14:28.987230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:17.889368+0000","scrub_duration":0.001924799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:14.918924+0000","last_change":"2024-04-26T12:14:14.918924+0000","last_active":"2024-04-26T12:14:14.918924+0000","last_peered":"2024-04-26T12:14:14.918924+0000","last_clean":"2024-04-26T12:14:14.918924+0000","last_became_active":"2024-04-26T12:09:49.370935+0000","last_became_peered":"2024-04-26T12:09:49.370935+0000","last_unstale":"2024-04-26T12:14:14.918924+0000","last_undegraded":"2024-04-26T12:14:14.918924+0000","last_fullsized":"2024-04-26T12:14:14.918924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:14.918752+0000","last_clean_scrub_stamp":"2024-04-26T12:14:14.918752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:08.147282+0000","scrub_duration":0.0020495079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"71'3","reported_seq":40,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:57.826300+0000","last_change":"2024-04-26T12:14:57.826300+0000","last_active":"2024-04-26T12:14:57.826300+0000","last_peered":"2024-04-26T12:14:57.826300+0000","last_clean":"2024-04-26T12:14:57.826300+0000","last_became_active":"2024-04-26T12:13:14.388858+0000","last_became_peered":"2024-04-26T12:13:14.388858+0000","last_unstale":"2024-04-26T12:14:57.826300+0000","last_undegraded":"2024-04-26T12:14:57.826300+0000","last_fullsized":"2024-04-26T12:14:57.826300+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:57.826169+0000","last_clean_scrub_stamp":"2024-04-26T12:14:57.826169+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:06.377686+0000","scrub_duration":0.0034205799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:55.865871+0000","last_change":"2024-04-26T12:14:55.865871+0000","last_active":"2024-04-26T12:14:55.865871+0000","last_peered":"2024-04-26T12:14:55.865871+0000","last_clean":"2024-04-26T12:14:55.865871+0000","last_became_active":"2024-04-26T12:13:14.392842+0000","last_became_peered":"2024-04-26T12:13:14.392842+0000","last_unstale":"2024-04-26T12:14:55.865871+0000","last_undegraded":"2024-04-26T12:14:55.865871+0000","last_fullsized":"2024-04-26T12:14:55.865871+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:55.865666+0000","last_clean_scrub_stamp":"2024-04-26T12:14:55.865666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:46.563067+0000","scrub_duration":0.036040151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'3","reported_seq":49,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:22.825288+0000","last_change":"2024-04-26T12:14:22.825288+0000","last_active":"2024-04-26T12:14:22.825288+0000","last_peered":"2024-04-26T12:14:22.825288+0000","last_clean":"2024-04-26T12:14:22.825288+0000","last_became_active":"2024-04-26T12:13:14.386399+0000","last_became_peered":"2024-04-26T12:13:14.386399+0000","last_unstale":"2024-04-26T12:14:22.825288+0000","last_undegraded":"2024-04-26T12:14:22.825288+0000","last_fullsized":"2024-04-26T12:14:22.825288+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3","last_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_deep_scrub":"71'3","last_deep_scrub_stamp":"2024-04-26T12:14:22.825158+0000","last_clean_scrub_stamp":"2024-04-26T12:14:22.825158+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:07.535329+0000","scrub_duration":0.0029636649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:15.751719+0000","last_change":"2024-04-26T12:15:15.751719+0000","last_active":"2024-04-26T12:15:15.751719+0000","last_peered":"2024-04-26T12:15:15.751719+0000","last_clean":"2024-04-26T12:15:15.751719+0000","last_became_active":"2024-04-26T12:13:14.387625+0000","last_became_peered":"2024-04-26T12:13:14.387625+0000","last_unstale":"2024-04-26T12:15:15.751719+0000","last_undegraded":"2024-04-26T12:15:15.751719+0000","last_fullsized":"2024-04-26T12:15:15.751719+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:15.751598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:15.751598+0000","last_clean_scrub_stamp":"2024-04-26T12:15:15.751598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:58.908818+0000","scrub_duration":0.001834163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:12.233933+0000","last_change":"2024-04-26T12:14:12.233933+0000","last_active":"2024-04-26T12:14:12.233933+0000","last_peered":"2024-04-26T12:14:12.233933+0000","last_clean":"2024-04-26T12:14:12.233933+0000","last_became_active":"2024-04-26T12:09:48.931756+0000","last_became_peered":"2024-04-26T12:09:48.931756+0000","last_unstale":"2024-04-26T12:14:12.233933+0000","last_undegraded":"2024-04-26T12:14:12.233933+0000","last_fullsized":"2024-04-26T12:14:12.233933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-26T12:14:12.233775+0000","last_clean_scrub_stamp":"2024-04-26T12:14:12.233775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:07.781137+0000","scrub_duration":0.0019158669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:23.956084+0000","last_change":"2024-04-26T12:15:23.956215+0000","last_active":"2024-04-26T12:15:23.956084+0000","last_peered":"2024-04-26T12:15:23.956084+0000","last_clean":"2024-04-26T12:15:23.956084+0000","last_became_active":"2024-04-26T12:09:49.378396+0000","last_became_peered":"2024-04-26T12:09:49.378396+0000","last_unstale":"2024-04-26T12:15:23.956084+0000","last_undegraded":"2024-04-26T12:15:23.956084+0000","last_fullsized":"2024-04-26T12:15:23.956084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:23.956059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:23.956059+0000","last_clean_scrub_stamp":"2024-04-26T12:15:23.956059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:00.602697+0000","scrub_duration":0.017105076,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":100,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.131175+0000","last_change":"2024-04-26T12:13:51.403595+0000","last_active":"2024-04-26T12:14:02.131175+0000","last_peered":"2024-04-26T12:14:02.131175+0000","last_clean":"2024-04-26T12:14:02.131175+0000","last_became_active":"2024-04-26T12:13:14.396053+0000","last_became_peered":"2024-04-26T12:13:14.396053+0000","last_unstale":"2024-04-26T12:14:02.131175+0000","last_undegraded":"2024-04-26T12:14:02.131175+0000","last_fullsized":"2024-04-26T12:14:02.131175+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-04-26T12:13:51.403445+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.403445+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.128483+0000","scrub_duration":0.004105236,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:55.798629+0000","last_change":"2024-04-26T12:13:55.798629+0000","last_active":"2024-04-26T12:13:55.798629+0000","last_peered":"2024-04-26T12:13:55.798629+0000","last_clean":"2024-04-26T12:13:55.798629+0000","last_became_active":"2024-04-26T12:13:14.391742+0000","last_became_peered":"2024-04-26T12:13:14.391742+0000","last_unstale":"2024-04-26T12:13:55.798629+0000","last_undegraded":"2024-04-26T12:13:55.798629+0000","last_fullsized":"2024-04-26T12:13:55.798629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:55.798482+0000","last_clean_scrub_stamp":"2024-04-26T12:13:55.798482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:15.137890+0000","scrub_duration":0.0017717709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:59.857635+0000","last_change":"2024-04-26T12:14:59.857635+0000","last_active":"2024-04-26T12:14:59.857635+0000","last_peered":"2024-04-26T12:14:59.857635+0000","last_clean":"2024-04-26T12:14:59.857635+0000","last_became_active":"2024-04-26T12:13:14.386271+0000","last_became_peered":"2024-04-26T12:13:14.386271+0000","last_unstale":"2024-04-26T12:14:59.857635+0000","last_undegraded":"2024-04-26T12:14:59.857635+0000","last_fullsized":"2024-04-26T12:14:59.857635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:14:59.857514+0000","last_clean_scrub_stamp":"2024-04-26T12:14:59.857514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.374584+0000","scrub_duration":0.0018552919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:14:02.130960+0000","last_change":"2024-04-26T12:13:47.406311+0000","last_active":"2024-04-26T12:14:02.130960+0000","last_peered":"2024-04-26T12:14:02.130960+0000","last_clean":"2024-04-26T12:14:02.130960+0000","last_became_active":"2024-04-26T12:09:49.378023+0000","last_became_peered":"2024-04-26T12:09:49.378023+0000","last_unstale":"2024-04-26T12:14:02.130960+0000","last_undegraded":"2024-04-26T12:14:02.130960+0000","last_fullsized":"2024-04-26T12:14:02.130960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:47.406151+0000","last_clean_scrub_stamp":"2024-04-26T12:13:47.406151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.588852+0000","scrub_duration":0.0018261379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":93,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:11.940980+0000","last_change":"2024-04-26T12:15:11.940980+0000","last_active":"2024-04-26T12:15:11.940980+0000","last_peered":"2024-04-26T12:15:11.940980+0000","last_clean":"2024-04-26T12:15:11.940980+0000","last_became_active":"2024-04-26T12:13:14.393913+0000","last_became_peered":"2024-04-26T12:13:14.393913+0000","last_unstale":"2024-04-26T12:15:11.940980+0000","last_undegraded":"2024-04-26T12:15:11.940980+0000","last_fullsized":"2024-04-26T12:15:11.940980+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:11.940858+0000","last_clean_scrub_stamp":"2024-04-26T12:15:11.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:57.982279+0000","scrub_duration":0.001908426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:15:03.276737+0000","last_change":"2024-04-26T12:15:03.276737+0000","last_active":"2024-04-26T12:15:03.276737+0000","last_peered":"2024-04-26T12:15:03.276737+0000","last_clean":"2024-04-26T12:15:03.276737+0000","last_became_active":"2024-04-26T12:09:49.378492+0000","last_became_peered":"2024-04-26T12:09:49.378492+0000","last_unstale":"2024-04-26T12:15:03.276737+0000","last_undegraded":"2024-04-26T12:15:03.276737+0000","last_fullsized":"2024-04-26T12:15:03.276737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:15:03.276548+0000","last_clean_scrub_stamp":"2024-04-26T12:15:03.276548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:41.773127+0000","scrub_duration":0.030246775,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":92,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T12:13:51.928338+0000","last_change":"2024-04-26T12:13:51.928338+0000","last_active":"2024-04-26T12:13:51.928338+0000","last_peered":"2024-04-26T12:13:51.928338+0000","last_clean":"2024-04-26T12:13:51.928338+0000","last_became_active":"2024-04-26T12:13:14.394556+0000","last_became_peered":"2024-04-26T12:13:14.394556+0000","last_unstale":"2024-04-26T12:13:51.928338+0000","last_undegraded":"2024-04-26T12:13:51.928338+0000","last_fullsized":"2024-04-26T12:13:51.928338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:13:51.928205+0000","last_clean_scrub_stamp":"2024-04-26T12:13:51.928205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:01.171903+0000","scrub_duration":0.0017174130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738450,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369024,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":368254,"kb_avail":94002816,"statfs":{"total":96636764160,"available":96258883584,"internally_reserved":0,"allocated":778240,"data_stored":304762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":377092550},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.45100000000000001},"min":{"1min":0.38400000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.63100000000000001,"5min":1.504,"15min":1.504},"last":0.441},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.60199999999999998,"5min":2.383,"15min":2.383},"last":0.505}]}]},{"osd":0,"up_from":64,"seq":274877906983,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44124,"kb_used_data":1364,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94327716,"statfs":{"total":96636764160,"available":96591581184,"internally_reserved":0,"allocated":1396736,"data_stored":896876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7103,"internal_metadata":43770945},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.44500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738450,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289232,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94082608,"statfs":{"total":96636764160,"available":96340590592,"internally_reserved":0,"allocated":1384448,"data_stored":894105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:15:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57599999999999996,"5min":0.623,"15min":0.623},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.501,"15min":0.43099999999999999},"min":{"1min":0.36499999999999999,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.59299999999999997,"5min":2.214,"15min":2.214},"last":0.432},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.44700000000000001},"min":{"1min":0.34000000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.59099999999999997,"5min":2.294,"15min":2.294},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5509,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:16:19.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:16:20.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T12:16:20.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:16:20.470 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:16:20.471 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:09:49.360137+0000","modified":"2024-04-26T12:09:52.370114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:16:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-04-26T12:16:20.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:16:20.896 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:16:20.896 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:09:49.360137+0000","modified":"2024-04-26T12:09:52.370114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6803/1004619672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1004619672},{"type":"v1","addr":"172.21.15.45:6803","nonce":1004619672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:16:20.899 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-04-26T12:16:20.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:16:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-04-26T12:16:21.276 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":71,"fsid":"238e0384-60e0-4b21-9d3a-782265888521","created":"2024-04-26T12:09:34.034413+0000","modified":"2024-04-26T12:13:27.472666+0000","last_up_change":"2024-04-26T12:13:13.374165+0000","last_in_change":"2024-04-26T12:09:34.969233+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-26T12:09:42.899365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-26T12:09:42.935107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:09:47.482562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:09:48.344147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5e89d15-234b-43fa-a34c-aa6987125af4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":64,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":5984},{"type":"v1","addr":"172.21.15.71:6801","nonce":5984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":5984},{"type":"v1","addr":"172.21.15.71:6803","nonce":5984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":5984},{"type":"v1","addr":"172.21.15.71:6807","nonce":5984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":5984},{"type":"v1","addr":"172.21.15.71:6805","nonce":5984}]},"public_addr":"172.21.15.71:6801/5984","cluster_addr":"172.21.15.71:6803/5984","heartbeat_back_addr":"172.21.15.71:6807/5984","heartbeat_front_addr":"172.21.15.71:6805/5984","state":["exists","up"]},{"osd":1,"uuid":"cacdbf9c-7e2f-46fa-9e34-804a2afdb53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":40365},{"type":"v1","addr":"172.21.15.94:6801","nonce":40365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":40365},{"type":"v1","addr":"172.21.15.94:6803","nonce":40365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":40365},{"type":"v1","addr":"172.21.15.94:6807","nonce":40365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":40365},{"type":"v1","addr":"172.21.15.94:6805","nonce":40365}]},"public_addr":"172.21.15.94:6801/40365","cluster_addr":"172.21.15.94:6803/40365","heartbeat_back_addr":"172.21.15.94:6807/40365","heartbeat_front_addr":"172.21.15.94:6805/40365","state":["exists","up"]},{"osd":2,"uuid":"406b2884-83cb-4c28-885d-e6f9a3d25330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":40673},{"type":"v1","addr":"172.21.15.104:6801","nonce":40673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":40673},{"type":"v1","addr":"172.21.15.104:6803","nonce":40673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":40673},{"type":"v1","addr":"172.21.15.104:6807","nonce":40673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":40673},{"type":"v1","addr":"172.21.15.104:6805","nonce":40673}]},"public_addr":"172.21.15.104:6801/40673","cluster_addr":"172.21.15.104:6803/40673","heartbeat_back_addr":"172.21.15.104:6807/40673","heartbeat_front_addr":"172.21.15.104:6805/40673","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.032022+0000","dead_epoch":29},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.017304+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:09:40.048371+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1d","osds":[0,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:16:21.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T12:16:21.715 INFO:tasks.ceph.mds.a.smithi045.stderr: -2031> 2024-04-26T12:09:54.038+0000 7fcdf8e93700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:16:21.719 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T12:16:21.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T12:16:21.743 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2024-04-26T12:16:22.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T12:16:23.726 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2024-04-26T12:16:23.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T12:16:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2024-04-26T12:16:24.742 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:16:24.742 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T12:16:24.742 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:24.752 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T12:16:24.752 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:16:24.752 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:16:24.752 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:24.795 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:16:24.795 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:16:24.795 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:24.850 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:16:24.851 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:16:24.851 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:24.911 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:16:24.911 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:16:24.911 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:16:24.912 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:24.941 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:16:24.941 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T12:16:24.941 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:25.011 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T12:16:25.011 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:16:25.011 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:16:25.011 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:25.065 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:16:25.065 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T12:16:25.065 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:25.119 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T12:16:25.119 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T12:16:25.119 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:16:25.173 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T12:16:25.173 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:16:25.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T12:16:25.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:16:25.257 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:16:25.396 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-04-26T12:16:25.396 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:16:25.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-26T12:16:25.562 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:16:25.722 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:16:25.724 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/data/mon.a.tgz 2024-04-26T12:16:25.724 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-04-26T12:16:25.746 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.wOlefT2wcC 2024-04-26T12:16:25.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wOlefT2wcC 2024-04-26T12:16:25.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.wOlefT2wcC 2024-04-26T12:16:26.005 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.wOlefT2wcC is 397KB 2024-04-26T12:16:26.103 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.wOlefT2wcC 2024-04-26T12:16:26.124 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/data/mon.b.tgz 2024-04-26T12:16:26.124 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-04-26T12:16:26.186 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.Fxmksc7JIl 2024-04-26T12:16:26.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Fxmksc7JIl 2024-04-26T12:16:26.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.Fxmksc7JIl 2024-04-26T12:16:26.465 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.Fxmksc7JIl is 546KB 2024-04-26T12:16:26.541 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.Fxmksc7JIl 2024-04-26T12:16:26.562 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/data/mon.c.tgz 2024-04-26T12:16:26.563 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-04-26T12:16:26.623 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.ge30QZg8f3 2024-04-26T12:16:26.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ge30QZg8f3 2024-04-26T12:16:26.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.ge30QZg8f3 2024-04-26T12:16:26.904 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.ge30QZg8f3 is 546KB 2024-04-26T12:16:27.003 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.ge30QZg8f3 2024-04-26T12:16:27.024 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:16:27.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:16:27.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:16:27.069 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:16:27.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:16:27.129 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T12:16:27.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:16:27.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:16:27.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:16:27.146 DEBUG:teuthology.orchestra.run.smithi104:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:16:27.175 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:16:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:16:27.177 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:16:27.186 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:16:27.193 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:16:27.194 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi045/crash 2024-04-26T12:16:27.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:16:27.258 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi071/crash 2024-04-26T12:16:27.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:16:27.302 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi094/crash 2024-04-26T12:16:27.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:16:27.348 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi104/crash 2024-04-26T12:16:27.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:16:27.392 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:16:27.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:16:27.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:16:27.398 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:16:27.400 DEBUG:teuthology.orchestra.run.smithi104:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:17:08.920 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:17:08.921 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi045/log 2024-04-26T12:17:08.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:17:09.241 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi071/log 2024-04-26T12:17:09.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:17:10.482 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi094/log 2024-04-26T12:17:10.483 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:17:15.019 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi104/log 2024-04-26T12:17:15.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:17:20.377 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:17:20.387 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:17:20.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:17:20.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:17:20.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:17:20.395 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:17:20.521 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:17:20.531 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:17:20.531 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:17:20.534 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:17:20.536 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:17:20.538 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:17:20.551 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2024-04-26T12:17:20.552 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2024-04-26T12:17:20.555 INFO:teuthology.orchestra.run.smithi094.stderr:bash: ntpq: command not found 2024-04-26T12:17:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:bash: ntpq: command not found 2024-04-26T12:17:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:17:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-04-26T12:17:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +800us[ +805us] +/- 57ms 2024-04-26T12:17:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -1286us[-1281us] +/- 77ms 2024-04-26T12:17:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +172us[ +177us] +/- 69ms 2024-04-26T12:17:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:17:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:17:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-04-26T12:17:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +796us[ +810us] +/- 57ms 2024-04-26T12:17:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -1281us[-1267us] +/- 77ms 2024-04-26T12:17:20.559 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 64 +168us[ +179us] +/- 69ms 2024-04-26T12:17:20.560 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:17:20.561 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:17:20.561 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-04-26T12:17:20.561 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +795us[ +797us] +/- 57ms 2024-04-26T12:17:20.561 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -1280us[-1278us] +/- 77ms 2024-04-26T12:17:20.561 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +167us[ +169us] +/- 69ms 2024-04-26T12:17:20.561 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:17:20.562 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:17:20.562 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-26T12:17:20.563 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +805us[ +805us] +/- 57ms 2024-04-26T12:17:20.563 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -1268us[-1268us] +/- 77ms 2024-04-26T12:17:20.563 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +178us[ +178us] +/- 69ms 2024-04-26T12:17:20.563 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:17:20.563 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:17:20.578 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:17:20.579 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:17:20.594 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:17:20.679 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:17:20.795 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:17:20.871 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:17:20.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:20.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:20.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:21.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:21.018 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:21.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:21.055 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:21.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:21.088 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:17:21.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:17:21.108 INFO:teuthology.task.internal:Duration was 1306.782771 seconds 2024-04-26T12:17:21.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:17:21.117 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:17:21.117 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:17:21.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:17:21.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:17:21.125 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:17:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:21.178 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:21.181 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:21.213 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:21.567 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:17:21.567 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-04-26T12:17:21.567 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:17:21.597 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-04-26T12:17:21.597 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:17:21.624 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-04-26T12:17:21.624 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:17:21.651 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-04-26T12:17:21.651 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:17:21.675 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:17:21.675 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:17:21.678 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:17:21.681 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:17:21.693 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:17:21.762 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:17:21.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:17:21.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:17:21.768 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:17:21.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:17:21.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:17:21.884 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:17:21.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:17:21.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:17:21.945 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:17:21.976 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:17:22.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:17:22.015 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.020 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.023 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.049 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-04-26T12:17:22.050 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-04-26T12:17:22.070 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-04-26T12:17:22.078 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-04-26T12:17:22.119 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:22.140 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:22.157 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:22.177 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:17:22.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:22.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:17:22.204 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:17:22.204 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi045 2024-04-26T12:17:22.205 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:17:22.251 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi071 2024-04-26T12:17:22.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:17:22.289 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi094 2024-04-26T12:17:22.289 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:17:22.332 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674196/remote/smithi104 2024-04-26T12:17:22.332 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:17:22.376 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:17:22.376 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:22.379 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:22.381 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:22.384 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:22.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:17:22.436 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:17:22.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:17:22.446 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:17:22.446 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:17:22.449 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:17:22.450 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:17:22.453 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:17 /home/ubuntu/cephtest 2024-04-26T12:17:22.467 INFO:teuthology.orchestra.run.smithi045.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:17 /home/ubuntu/cephtest 2024-04-26T12:17:22.469 INFO:teuthology.orchestra.run.smithi094.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:17 /home/ubuntu/cephtest 2024-04-26T12:17:22.479 INFO:teuthology.orchestra.run.smithi104.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:17 /home/ubuntu/cephtest 2024-04-26T12:17:22.481 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:17:22.492 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:17:22.535 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1306.7827706336975 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T12:17:22.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:17:22.625 INFO:teuthology.run:pass